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Chapter  I 
Problem  On  Which  The  Research  Was  Focused 


The  major  problem  of  this  research  was  the  study  of  the  effects  of 
training  in  problem  solving. 

Previous  research  (Rimoldi,  Devane,  1961;   Rimoldi,  Meyer,  Meyer, 
Fogliatto,  1962;   Rimoldi,  Haley,  Fogliatto,  1962)  indicated  that  problem 
solving  processes  are  highly  individualized  performances  that  can  not  be 
characterized  solely  by  their  end  product.   The  tactics  followed  by  a  sub- 
ject are  important  in  revealing  his  approach  to  a  problem.   But  in  order  to 
evaluate  an  individual's  performance  in  a  given  problem  it  is  necessary  to 
know  the  characteristics  and  properties  built  in  the  problem  by  the  experi- 
menter. 

In  earlier  attempts  we  tried  to  analyze  the  properties  of  the  problems 
from  the  subjects'  performances.   This  approach  gave  very  useful  information 
about  each  subject  relative  to  his  group  and  about  the  problem  as  perceived 
by  that  group.  This  knowledge  made  it  possible  to  establish  a  set  of  speci- 
fications by  which  both  the  formal  properties  (schemata)  and  the  content  of 
the  problems  can  be  controlled  by  the  experimenter.  This  turned  out  to  be 
a  reasonable  and,  we  hope,  acceptable  way  of  programming  problems  of  graded 
"intrinsic"  difficulty.   (Rimoldi,  Haley,  Fogliatto,  Erdmann,  1962,  unpub- 
lished) . 

Being  able  to  better  control  the  problems,  their  "difficulty"  can  be 
systematically  varied  by  introducing  new  relationships  in  the  schemata  or 
by  changing  the  nature  of  the  content.  Then,  individual  and  intergroup 
comparisons  can  be  made  based  both  on  the  traditional  statistical  approach 
and  on  the  formal  properties  and  content  of  each  problem. 

One  of  our  long  standing  hopes  was  that  it  should  be  possible,  mostly 
when  dealing  with  the  appraisal  of  high  talent,  to  evaluate  subjects  using 
norms  that  do  not  depend  almost  exclusively  on  group  performances  but  rather 
on  the  nature  of  the  task.  A  tentative  solution  to  this  problem  is  presented 
in  this  study.   It  is  felt  that  individual  differences  do  not  need  neces- 
sarily to  be  studied  by  referring  to  group  norms  that  result  from  the  com- 
bining of  individual  performances  into  a  single  statement.   Secondly,  indi- 
vidual performances  may  differ  for  a  variety  of  reasons,  to  wit:   the  sub- 
ject's ability  to  understand  the  logical  structure  of  the  problem,  his 
familiarity  with  the  content,  his  facility  to  revise  modes  of  approach 
according  to  the  nature  of  the  problem,  etc.  .  .  . 

With  increased  ability  to  control  problems  from  the  standpoint  of 
familiarity  of  content  and  complexity  of  the  logical  structure,  it  was 
possible  to  study  individual  approaches  at  different  specified  levels. 
Changes  in  approach  were  studied  by  performance  curves  that  indicate  vari- 
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at  ions  due  to  the  complexity  of  the  logical  structure  and/or  the  familiarity 
of  the  content.   The  experimental  and  systematic  exploration  of  these  two 
areas  is  an  important  part  of  this  study. 

One  of  our  interests  has  been  to  compare  individual  performances  when 
evaluated  in  terms  of  group  norms  and  in  terms  of  the  schemata  and  content 
of  the  problems.  Variations  in  performances  due  to  differences  in  age, 
education  and  training  can  be  explored.  This  was  one  of  the  aims  of  this 
study.   Questioning  the  properties  of  the  schemata  in  a  factorial  sense 
resulted  from  this  approach.   Though  this  was  not  an  integral  part  of  this 
project  as  originally  conceived,  some  pilot  work  was  performed  along  this 
line. 

Specific  questions  raised  by  previous  research  (Rimoldi,  Devane,  1961; 
Rimoldi,  Haley,  1962a)  could  now  be  experimented  upon,  for  instance:   the 
effect  that  information  presented  in  a  negative  statement  may  have  upon 
problem  solving  ability;   how  this  affects  different  individuals;   the  con- 
sistency of  the  approach  followed  by  each  subject  throughout  all  the  prob- 
lems administered  to  him;   and  so  forth. 

In  the  original  proposal  two  main  types  of  problems  were  discussed. 
In  tyoe  a  the  subject  has  to  choose  from  a  set  of  questions  of  varying  de- 
grees of  relevancy  to  the  problem  those  that  he  considers  necessary  to 
solve  it.  After  choosing  the  question  he  obtains  the  corresponding  infor- 
mation.  In  type  b  the  subject  generates  his  own  questions.   In  this  re- 
search, problems  were  developed  for  these  situations. 

The  effects  of  training  in  problems  of  one  type  as  opposed  to  the  other 
and  the  transfer  that  may  occur  between  these  two  were  explored.   The  carry- 
over from  training  problems  to  new  unfamiliar  problems  and  the  performance 
in  crucial  tests }   some  of  them  repeated  before  and  after  the  experiment  was 
completed,  were  analyzed. 

The  development  of  appropriate  scoring  methods  and  techniques  to  deal 
with  the  observations  and  results  has  also  been  an  important  problem  in 
this  study.   These  will  be  detailed  in  the  rest  of  the  text. 
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Chapter  II 
Objectives  And/Or  Hypotheses 

The  main  objectives  of  this  study  are  the  following: 

1)  To  characterize  problem  solving  processes  at  an  individual  level. 

2)  To  study  how  training  improves  thinking  processes  without  pre- 
scribing "best"  ways  of  thinking  or  without  assuming  that  a  given 
problem  is  solvable  by  only  one  method. 


Questions  related  to  these  main  objectives  and  needed  for  their  clari- 
fication are  the  following: 

a)  Characterization  of  problem  solving  procedures  at  the  group  level 
based  on  group  norms. 

b)  Evaluation  of  the  effects  of  training  by  comparison  with  a  control 
group. 

c)  Effects  that  training  on  problems  of  one  type  have  on  problems  of 
a  different  kind  (see  Procedures). 

d)  Effects  of  training  in  problems  administered  before  and  after  the 
experiment  proper,  and  their  comparison  with  a  control  group. 

e)  Variations  in  processes  that  may  be  attributed  to  changes  in 
schemata  and  in  content. 

f)  Comparison  of  a,  b,  c,  d  and  e  above,  in  students  at  two  different 
educational  levels,  i.e.,  high  school  freshmen  and  college  fresh- 
men. 

g)  Comparison  of  performances  scored  using  group  norms  (statistical 
approach)  with  the  same  performance  scored  in  terms  of  the  pro- 
perties of  the  problem. 
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Chapter  III 
Related  Research 


Ma:c  Wertheimer3  in  his  book  "Productive  Thinking"  (1958),  suggests  the 
possibility  that  present  methods  used  in  education  may  stifle  rather  than 
stimulate  creativity.  Approaches  based  on  the  theory  of  association,  which 
emphasizes  repetition,  require  a  group  of  individuals  to  give  a  response 
which  is  associated  with  a  particular  stimulus.  Other  approaches  attempt  to 
analyze  the  type  of  logic  involved  in  thinking  and  to  develop  training 
methods  based  upon  this  logical  frame. 

The  teaching  methods  that  have  been  developed  from  these  two  general 
approaches  require  the  individual  in  the  group  to  adapt  himself  to  the 
method  and  to  respond  accordingly.   The  method  described  in  this  particular 
research  attempts  to  give  the  individual  the  freedom  to  adapt  the  method  to 
his  own  individual  style. 

This  approach  is  a  natural  outgrowth  of  an  attempt  to  evaluate  students 
in  terms  of  processes  rather  than  final  products.   It  was  found  that  many 
different  processes  can  lead  to  the  same  final  solution  or  answer.  When 
evaluation  is  based  only  on  the  end  product,  a  large  amount  of  information 
is  lost. 

One  of  the  earlier  studies  attempting  to  evaluate  individual  processes 
was  performed  by  Karl  Duncker  (1945).  He  gave  practical  and  mathematical 
problems  to  subjects  and  asked  them  to  "think  aloud"  in  their  attempts  to 
solve  them.   The  conclusions  of  this  study  were  that  the  final  solution  is 
arrived  at  by  successive  formulations  which  are  mediated  by  analyses  of  the 
conflict,  material  and  goal. 

Bloom  and  Broder,  in  their  monograph  "Iroblem  Solving  Processes  of 
College  Students"  (1950),  questioned  the  ability  of  aptitude  and  achievement 
measures  to  reflect  the  quality  of  the  examinees'  thinking.   They  suggested 
that  both  processes  and  products  should  compliment  one  another  in  any  evalu- 
ation.  In  this  study,  they  found  important  differences  between  the  methods 
of  students  who  passed  and  students  who  failed  their  comprehensive  examin- 
ations.  Significant  improvement  in  grades  was  also  observed  after  remedial 
sessions  devoted  to  the  analysis  of  the  subjects'  methods  in  comparison  to 
"model"  methods.   In  this  analysis,  they  employed  Duncker' s  "thinking  aloud" 
approach. 

A  technique  similar  to  the  one  described  in  this  study  was  presented 
by  Glaser,  Damrin  and  Gardner  (1954)  and  Bryan  (1954).   These  techniques 
were  specifically  applied  to  the  evaluation  of  trouble  shooting  in  electron- 
ics.  Both  the  administration  and  scoring  system  differ  from  those  used  in 
this  study.   These  differences  have  been  more  thoroughly  discussed  in  several 
papers  (Rimoldi,  1955,  1960). 
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John  and  Rimoldi  studied  the  sequential  properties  of  complex  reasoning 
by  means  of  the  PSI  machine  (John,  Rimoldi,  1955;   John,  1957).  Although 
this  apparatus  was  useful  in  studying  certain  phases  of  highly  abstract 
reasoning,  it  was  limited  by  the  nature  of  problems  that  could  be  presented, 
the  type  of  performance  required  of  the  subjects,  and  the  difficulty  of 
interpreting  the  results. 

Buswell  (1956)  attempted  to  define  common  patterns  in  the  solution  of 
simple  problems.  He  did  this  with  a  choice  situation  somewhat  similar  to 
the  techniques  used  in  this  study.   The  results  indicated  more  diversity 
than  similarity  in  problem  solving  approaches. 

Bruner,  Goodnow  and  Austin  (1960)  examined  variables  that  may  be  in- 
fluential in  problem  processes.  The  conceptual  formulation  of  this  study  is 
different  than  the  one  described  in  this  report.   In  a  more  recent  publi- 
cation, Bruner  discusses  problem  solving  in  relation  to  educational  problems 
(1960). 

Tate,  Stanier,  and  Harootunian  (1959)  studied  good  and  poor  problem 
solvers.  They  found  that  good  problem  solvers  are  significantly  better  than 
poor  in  tests  where  quality  of  response,  accuracy  or  judgement  is  required 
and  without  exception,  the  more  complex  the  tack  or  the  more  restricted  the 
requirements,  the  greater  their  superiority.  Though  their  study  does  not 
aim  at  analyzing  processes  in  themselves,  it  docs  attempt  to  characterise 
good  and  poor  problem  solvers.  A  test  called  Thought  Problems,  which  they 
prepared  for  their  study,  has  bean  used  in  the  present  research. 

Recently,  D.  M.  Johnson  (1961)  found  that  the  processes  called  "pre- 
paration" and  "solution"  could  be  isolated  in  problem  solving  situations  and 
that  the  performance  of  the  subjects  could  be  predicted  in  terms  of  the 
training  series  that  preceeded  the  crucial  testing  of  the  hypothesis. 

The  technique  to  be  used  in  this  study  was  devised  by  Rimoldi  (1955) . 
It  was  specifically  applied  to  the  evaluation  of  medical  students  making 
clinical  diagnoses.   In  this  technique,  emphasis  was  placed  on  the  processes 
leading  to  a  diagnosis  rather  than  on  the  diagnosis  itself.   Over  a  period 
of  six  years,  research  was  performed  to  develop  scoring  methods  and  new 
forms  of  the  test.   This  work  is  summarized  in  a  final  report  entitled 
"The  Test  of  Diagnostic  Skills"  (Rimoldi,  Haley,  Fogliatto,  1962).  At  the 
present  time  plans  are  being  formulated  to  use  these  tests  to  train  medical 
students. 

This  technique  has  been  applied  in  a  variety  of  areas,  e.g.,  Rorschach 
interpretation  (Tabor,  1959),  interdisciplinary  evaluation  of  organic 
pathology  (Mohrbachar,  1960),  appraisal  of  personality  parameters  (Gunn, 
1961),  decision  processes  in  mathematical  thinking  (Rimoldi,  Haley, 
Majewska,  1963,  unpublished),  and  changes  in  complex  mental  processes  with 
age  (Rimoldi,  Meyer,  Meyer,  Fogliatto,  1962). 


The  present  research  is  a  continuation  of  a  previous  study  (Rimoldi, 
Devane,  1961),  in  which  only  high  school  students  were  used.  They  were 
trained  in  problems  that  were  less  clearly  defined  or  controlled  than  in 
the  present  study.   The  training  procedure  was  the  same  in  both  studies. 
Subjects  were  allowed  complete  freedom  in  developing  and  improving  their 
own  approach.   Each  evaluated  his  own  procedure  without  any  direct  guidance 
on  the  part  of  the  tester.   Subjects  who  had  been  trained  showed  more 
efficiency  in  solving  problems,  greater  agreement  among  themselves  as  to 
which  questions  were  useful  in  reaching  a  solution,  and  a  higher  grade  in 
mathematics.  This  study  raised  many  questions  related  to  problem  solving 
and  training,  ^ome  of  which  will  be  treated  in  detail  in  this  report. 

Since  teaching  machines  are  designed  to  reinforce  predefined  "correct 
solutions",  they  are  not  comparable  to  the  approach  used  in  this  study.   The 
rationale  underlying  the  use  of  the  teaching  machine  is  based  on  association, 
repetition  and  reinforcement.   Other  than  time  factors,  there  is  no  attempt 
to  adapt  the  machine  to  a  subject's  individual  rjtyle.   We  do  not  deny  the 
applicability  of  the  underlying  theory  itself,  but  prefer  to  avoid  theoriz- 
ing and  instead  allow  the  subject  freedom  to  perform  in  the  manner  that  he 
thinks  is  most  suitable.   In  doing  so,  it  is  hoped  that  the  possibility  of 
the  subject  being  forced  to  perform  according  to  some  theoretical  model  is 
minimized. 
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Chapter  IV 

Procedure 


Table  1  presents  the  general  experimental  design.  The  total  number 
of  subjects  used  in  the  study  was  100  of  which  50  correspond  to  the  experi- 
mental and  50  to  the  control  group.   Each  group  was  divided  into  two  sub- 
samples  of  subjects  corresponding  to  24  male  college  freshmen  and  26  male 
high  school  freshmen. 

According  to  the  type  of  problems  administered,  each  sub-sample  was 
further  divided  into  groups  a  and  b.  Group  a  includes  all  those  subjects 
that  were  first  trained  in  problems  of  type  a,  and  later  in  problems  of 
type  b.   In  group  b  the  order  was  reversed.  There  is  a  group  a  and  a  group 
b  for  both  the  college  and  high  school  freshmen.  This  distinction  between 
groups  a  and  b  is  not  necessary  for  the  control  subjects. 

During  the  pre-testing  session  the  following  tests  were  administered 
to  the  100  subjects  (experimental  and  control):   Raven  Progressive  Matrices 
Test;  Thought  Problems,  Part  I,  which  includes  the  first  twenty  items  of 
the  test  of  the  same  name  developed  by  Tate,  Stanier  and  Harootunian  (Tate, 
Stanier,  and  Harootunian,  1959);   and  problems  1,  19  and  25  as  given  in 
Appendix  I. 

Subjects  belonging  to  group  a  were  administered  first  the  forms  A,  B, 
C  and  D  of  problems  31,  33  and  35 ,  and  forms  A  and  B  of  problem  37.   The 
high  school  group  a  was  not  given  forms  A  and  B  of  problem  37.   After  a  mid- 
testing  session,  subjects  of  group  a  were  administered  forms  A,  B,  C  and  D 
of  problems  32,  34  and  36.  Only  the  college  freshmen  were  given  forms  A 
and  B  of  test  38.   By  looking  at  Table  1,  it  should  be  easy  to  realize  that 
the  order  of  presentation  of  the  problems  was  reversed  for  group  b. 

The  mid-testing  session  was  identical  for  all  the  experimental  subjects 
and  took  place  only  after  the  first  training  session  had  been  completed 
and  before  starting  the  second  training  session.   The  problems  administered 
were  31C*,  35A' ,  32E  and  36E. 

Problems  indicated  with  odd  numbers  are  of  type  a,  while  those  indi- 
cated with  even  numbers  are  of  type  b  with  the  exception  of  problems  1,  19, 
25,  26  and  41A.  Thus  in  the  mid-testing  session,  each  experimental  subject 
was  given  two  problems  similar  to  the  type  of  problems  used  during  training 
and  two  problems  of  the  type  not  yet  used  in  training. 

The  final  testing  was  identical  for  all  the  subject  including  controls. 
The  instruments  administered  were:   Thought  Problems,  Part  II  (Tate,  Stanier, 
and  Harootunian,  1959);  and  problems  1,  19  and  25  (that  had  already  been 
administered  in  the  pre-testing  session);   31D' ,  35B' ,  32F  and  36F,  that 
correspond  to  problems  similar  to  those  used  in  the  first  or  second  training 
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sessions;  and  problems  26  and  41A,  that  were  different  both  in  content  and 
structure  from  the  other  problems. 

The  control  subjects  (high  school  freshmen)  were  given  the  Rotter  In- 
complete Sentences  Blank  and  the  Rozensweig  Picture  Frustration  Test,  in  an 
attempt  to  eliminate  at  least  partially  the  Hawthorne  effect. 

Subjects 

a)  High  School  Freshmen. 

A  letter  was  sent  to  the  parents  of  those  freshmen  at  St.  Ignatius 
High  School  in  Chicago,  Illinois,  whose  IQ  in  the  Henmon-Nelson  Test  of 
Mental  Ability  was  120  or  above.   The  nature  of  the  research  was  explained 
and  the  consent  of  the  parents  was  requested  to  let  their  sons  participate 
in  the  study. 

Seventy  students  were  selected.   Raven's  Progressive  Matrices  Tests 
and  Thought  Problems,  Part  I,  were  administered  to  all  of  them.  Twenty- 
six  experimental -control  pairs  were  assembled  and  each  pair  matched  for  IQ 
and  score  in  Raven's  test.   Each  member  of  the  pair  was  randomly  assigned 
to  the  experimental  or  control  groups. 

The  means  and  standard  deviations  for  the  IQ's  and  Raven's  Scores  are 
given  in  Table  2.  The  paired  intercorrelations  were  .98  for  the  IQ  scores 
and  .88  for  the  Raven  Scores. 

;e  Freshmen. 

From  a  large  number  of  college  freshmen  that  were  contacted,  fifty 
were  selected  for  the  experiment.  Two  of  them  dropped,  leaving  a  final 
total  of  forty-eight  students. 

The  matching  of  pairs  of  subjects  to  be  finally  assigned  to  the  ex- 
perimental and  control  groups  was  performed  using  their  scores  in  Raven's 
Progressive  Matrices  Test  and  Thought  Problems }   Part  I.   For  this  sample 
it  was  not  possible  to  match  in  terms  of  already  available  IQ's,  because 
the  school  records  could  not  be  easily  compared.  After  this  matching  was 
performed,  the  subjects  of  each  pair  were  randomly  assigned  to  the  experi- 
mental and  control  groups. 

The  mean  and  standard  deviation  for  Thought  Problems,  Part  I,  and 
Raven's  Test  are  given  in  Table  2.   The  paired  intercorrelations  were  .33 
for  Raven's  Test  and  .88  for  Thought  Problems,  Part  I. 

In  both  the  experimental  and  the  control  group,  a  few  subjects  dropped 
out  in  the  course  of  the  experiment.  The  number  of  subjects  that  took  each 
problem  is  shown  in  Tables  5  through  13  inclusive. 
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Table  2 


Mean,  Standard  Deviation  and  Number  of  Subjects 

for  Raven,  IQ,  Thought  Problems,  Part  I  and  Part  II, 

for  High  School  and  College  Freshmen 


' 

High  School                        j 

College                           | 

Tests 

Control            i      Experimental |     Control            |   Experimental 

N  ofi               |           N  of;                        jsr  of1                        «  of 
M         °     Sub]       M     1    °     Lb]     M      !    °     gubj     M     |    °     Lj 

1 

f      Raven 

i 

1 

50.27'  3.93J  26  1   49.23!  4.17J  26    51.75)  4.73J  24    52.12J  4.24)  24 

Pre-       j          IQ 
Testing  |        

125.58J  7.93i  26  1125.88!  7.55J  26  j 

MM 

1   Thought 
Problem  I 

11.55!  3.41j  24  |    11.88J  3.75   26  J12.72 

3.34)  24  (l  3.09}  3.  33J  24 

Post-    j    Thought 
Testing 'Problem  II 

13.99|  3.39i  24j    12.64j  3.98)  25  (15.98 

1.92J  21  |l6.66j  2.40)  19 

Problems 

a)  General  Considerations. 

A  total  of  41  problems  were  developed  of  which  37  were  prepared  for 
this  research.   The  basic  rationale  underlying  this  research  is  based  on 
the  assumption  that  complex  mental  processes  can  be  described  by  the  se- 
quence of  questions  that  a  subject  asks  when  solving  a  problem.   This 
procedure  stresses  the  process  rather  than  the  end  product.   It  may  be 
said  that  "the  subject  acts  as  a  highly  selective  analyzer  of  stimuli  and 
organizer  of  information.   At  every  discrete  experimental  stage  the  nature 
of  the  problem  changes.  Accumulation  of  relevant  knowledge  and  decrement 
of  ignorance  can  be  specifically  related  to  every  stage  in  the  process, 
provided  this  stage  can  be  identified  experimentally."   (Rimoldi,  Haley, 
Fogliatto,  Erdmann,  1962,  unpublished). 


Two  general  types  of  problems  were  constructed.   In  the  first  type 
(a)  the  subject  is  presented  with  a  problem  and  a  set  of  cards  containing 
questions  that  he  may  ask  in  order  to  reach  a  solution.   The  subject  is 
free  to  choose  any  card  in  any  order  he  wishes.   The  corresponding  answer 
to  each  question  is  written  on  the  reverse  side  of  the  card.   When  the  sub- 
ject thinks  that  he  has  gained  sufficient  information  to  solve  the  problem 
correctly,  he  stops  selecting  cards  and  gives  his  solution.   The  experimen- 
ter records  the  questions  in  the  order  in  which  they  were  asked.   These 
problems  have  no  time  limit. 
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In  the  second  type  of  problem  (b)  a  drawing  or  figure  is  presented  to 
the  subject  who  is  asked  to  identify  some  part  of  the  figure.  Here  the 
subject  is  allowed  to  generate  his  own  questions  and  the  experimenter  pro- 
vides the  answer.   When  the  subject  feels  that  he  can  accurately  identify 
the  prescribed  area  of  the  drawing  he  stops  asking  questions  and  gives  his 
answer.   Since  each  part  of  the  figure  presented  to  the  subject  is  identified 
by  a  number  or  a  letter,  it  is  an  easy  matter  for  the  experimenter  to  know 
the  sequence  of  questions  asked.   These  problems  have  no  time  limit. 

Developing  techniques  to  evaluate  these  results  has  been  a  very  diffi- 
cult problem.  Many  approaches  have  been  tried  with  varying  degrees  of 
success  (Rimoldi,  Crib,  1960a,  1960b;  Rimoldi,  Devane,  Haley,  1961).  A 
method  was  finally  developed  which  took  into  consideration  both  frequency 
and  order  of  selection  (Rimoldi,  Haley,  1962a,  1962b).   This  approach  was 
based  upon  norms  that  depended  at  least  partially  on  group  performance. 

As  stated  above  a  problem  of  crucial  importance  was  to  develop  norms 
that  were  dependent  upon  the  nature  of  the  problem  itself  rather  than  the 
performance  of  a  particular  group.   It  was  in  trying  to  solve  this  problem 
that  ways  were  devised  for  preparing  instruments  in  such  a  way  that  their 
content  and  structure  could  be  controlled. 

The  word  "structure"  as  used  in  this  report  refers  to  the  formal  pro- 
perties or  schema  of  the  problem  expressed  in  terms  of  a  basic  set  of  logi- 
cal relationships.   "These  'schemata'  are  the  logical  frames  on  which 
various  types  of  objects  may  be  superimposed.   By  changing  the  formal  pro- 
perties of  problems,  various  levels  of  complexity  can  be  defined.   Each  one 
of  these  levels  is  thus  objectively  characterized,  so  that  different 
investigators  will  have  the  same  set  of  references  when  using  a  given 
schema."   (Rimoldi,  Haley,  Fogliatto,  Erdmann,  1962,  unpublished).  For  this 
study  a  graded  set  of  schemata  was  prepared. 

"The  objects  (content)  used  to  realize  the  problems  may  consist  of 
words,  numbers,  letters,  negative  statements,  drawings,  etc.,  representing 
concrete  or  abstract  propositions.   The  same  logical  frame  can  be  presented 
with  content  that  refers  to  every  day  fnmiliar  situations  or  in  a  problem 
dealing  with  symbols,  familiar  or  unfamiliar  to  the  subject,  etc.   Since 
every  schema  can  be  presented  using  different  classes  of  content  and  since 
the  same  type  of  content  can  be  used  in  different  schema,  an  experimental 
program  for  the  study  of  the  importance  of  these  components  in  the  thinking 
process  can  be  developed. 

"The  difficulty  of  each  problem  becomes  an  'intrinsic'  property  of  the 
problem  and  is  defined  in  terms  of  the  relationships  used  in  the  correspond- 
ing schema.   This  difficulty  can  be  experimentally  operated  on  by  changing 
the  type  and  number  of  relations  used. 

"The  objects  used  to  realize  the  problem  can  be  drawn  from  a  variety 
of  sources.   The  familiarity  with  these  sources  may  be  important  in  the 
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solution  of  the  problem.   Thus  the  same  schema  with  different  content  may 
bring  about  different  performances  in  the  same  subject."  (Rimoldi,  Haley, 
Fogliatto,  Erdmann,  1962,  unpublished). 

The  logical  analysis  of  the  "schemata"  provides  a  set  of  norms  that 
may  be  considered  to  be  experimentally  independent  to  the  norms  developed 
from  group  performance  in  the  problems.   The  first  will  refer  to  "intrinsic" 
difficulty,  while  the  second,  corresponds  to  the  "extrinsic"  difficulty  of 
the  problems  that  reflects  intrinsic  difficulty,  familiarity  with  content 
and  a  host  of  other  variables 
ences,  sampling  errors,  etc. 

b)   Problems  Used  In  This  Study 

1)  Pre-Testing 

Problems  1,  19  and  25  were  used  in  the  pre-testing  session.   They  were 
obtained  from  a  previous  study  (Rimoldi,  Davane,  1961)  and  were  not  built 
following  the  specifications  described  above,   (see  Appendix  I). 

These  problems  serve  a  twofold  purpose:   to  acquaint  subjects  with  the 
technique  to  be  used  in  the  experiment  proper;   and  to  compare  subjects' 
abilities  to  perform  prior  to  training  sessions. 

2)  Training  Sessions 

Problems  31  to  36  inclusive  had  four  forms  each  (A,  B,  G,  D)  while 
problems  37  and  38  had  only  two  forms  (A  and  B).   These  problems  were  used 
in  the  training  sessions  as  shown  in  Table  1.   Type  a  problems  will  be  des- 
cribed first,  i.  e.,  31,  33,  35  and  37  in  all  their  forms.   The  designation 
for  problems  of  type  a  as  A,  B,  C  or  D  hinges  upon  the  content  used,  while 
the  numbers  31,  33,  35  and  37  refers  to  the  schemata  used. 

Type  a  Problems  (31,  33,  35,  37). 

Form  A  of  the  problems  involves  concrete  every  day  situations,  i.e., 
school,  employment,  etc.,  as  can  be  seen  in  Appendix  I.   The  content  of 
form  B  of  the  problems  is  letters  that  represent  symbolically  non-specified 
concrete  objects.   In  problems  of  form  C  the  questions  are  presented  using 
negative  statements,  i.e.,  .  .  ."Are  there  more  not-D's  than  not-A's  among 
the  F's?".   In  forms  A,  B  and  C  the  solution  of  the  problem  requires  the 
use  of  numbers. 

D  problems  are  similar  to  B  problems  in  as  far  as  letters  stand  for 
non-specified  concrete  objects.  The  solution  here  requires  the  use  of  let- 
ters instead  of  numbers  so  the  idea  of  quantity  is  not  necessary  for  the 
solution,  i.e.,.  .  ."How  many  L's  are  M's?  Answer:   Y  +  F  =  X".   These 
represent  the  highest  degree  of  abstraction  in  our  set  of  problems.  The 
schema  for  problems  31A,  31B,  31C,  and  31D  may  be  represented  as  a  tree 
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though  other  graphical  representations  may  be  used.   In  Figure  1  their  basic 
logical  structure  is  depicted. 


B 
/ 


D 


G 


A1 
*4R 


Figure  1 


In  Figure  1,  which  corresponds  to  problem  31A,  the  letter  D  represents 
the  high  school  dance  committee,  B  stands  for  boys  and  G  for  girls  in  the 
committee,  T  and  R  for  individuals  who  sell  tickets  or  take  care  of  refresh- 
ments respectively.   (See  Appendix  I). 

If  we  call  the  dance  committee  C,  and  boys  B,  girls  G,  tickets  T  and 
refreshments  R,  we  obtain  problem  31B.   By  calling  D  not-X,  and  by  calling 
B  not -A,  G  not-D,  T  not-P  and  R  not-S,  we  obtain  problem  31C.   Problem  31D 
will  be  similar  to  problem  31B,  though  different  letters  will  be  used,  but, 
as  stated  above,  the  answers  to  the  questions  are  in  letters  rather  than 
numbers . 

It  should  be  noticed  that  Figure  1  could  be  also  represented  by  a 
schema  in  which  the  first  two  branches  lead  to  T  and  R,  and  the  final 
branches  to  B  and  G  as  shown  in  Figure  2. 


„T 
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.B 

^G 

Figure   2 

The  remaining  problems  will  be  more  summarily  described.   The  inter- 
pretation of  them  is  along  the  lines  used  to  describe  problem  31. 
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In  Figure  3,    representations  of  problems  33A,  33B,  33C  and  33D,  are 


given. 
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Figure  3 


By  comparison  with  all  the  problems  numbered  31,  those  listed  as  33 
have  a  tree  with  both  a  dichotomy  and  trichotomy. 

In  Figure  4,  which  gives  the  schemata  of  problems  35A,  35B,  35G  and 
35D,  two  trichotomies  are  involved. 


Figure  4 
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A  convergence  of  branches  is  introduced  into  the  trees  that  represent 
problem  37A  and  37B.  The  schema  for  these  problems  is  presented  in  Figure  5, 


sjE 
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C 

\C 

\ 

■■   D  — 5  H 
Figure  5 


Inspection  of  Figures  1  to  5  indicates  how  the  complexity  of  the 
schemata  may  be  controlled.   This  may  refer  to  number  of  branches,  different 
combinations  of  subdivisions  of  the  branches,  their  convergence  or  diver- 
gence, etc.  These  components  may  be  varied  at  will,  within  restrictions 
implied  mostly  by  practical  limitations.   Schemata  of  graded  "intrinsic" 
difficulty  may  be  built  and  different  "contents"  used  to  realize  them. 

Type  b  Problems 


No  general  statement  can  be  made  about  the  content  of  Forms  A,  B,  C, 
and  D  of  type  b  problems.   Nevertheless,  all  problems  having  the  same 
identifying  number  have  exactly  the  same  figure.   Further,  it  was  assumed 
that  changing  the  type  of  lines  and  their  color,  as  well  as  changing  the 
number  of  areas,  the  complexity  of  the  problem  could  be  varied.  Thus, 
problems  32,  34,  36  and  33  were  developed.   The  answer  to  the  questions 
were  given  either  in  numbers   (positive  or  negative),  letters  (positive  or 
negative)  and  their  combinations,  thus  introducing  the  idea  of  series,  from 
simple  to  complex  and  requiring  the  subject  to  decode  the  answers  in  order 
to  find  the  rationale.   For  instance,  an  answer  may  be  3a  +  b,  because  this 
corresponds  to  one  area  limited  by  three  straight  whole  lines  (a)  and  a 
colored  dotted  line  (b).   The  reader  is  referred  to  Appendix  I  where  the 
rationale  of  each  problem  is  presented,  and,  by  comparison,  observe  the 
progressive  levels  of  complexity. 

All  forms  of  problem  32  made  use  of  the  same  figure  (Appendix  I).   This 
figure  was  a  large  square  subdivided  into  twenty  areas.   The  lines  used  for 
these  subdivisions  were  either  solid  or  broken  straight  lines,  or  curved 
lines.   In  form  "A"  two  series  of  three  letters  each  were  alternated  start- 
ing at  the  upper  left  hand  corner  and  moving  from  left  to  right,  top  to 
bottom. 
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In  form  B  a  letter  series  and  a  number  series  were  used.  Although 
letters  and  numbers  were  alternated  in  groups  of  three,  each  series  was 
continued  from  the  last  step,  for  instance,  .  .  .  abc  123  def  456.   Form  G 
is  similar  to  form  B,  however,  only  numbers  are  employed,  one  set  positive, 
the  other  negative.   Numbers  were  also  used  in  form  D.   This  form  of  the 
test  was  further  complicated  Docause  the  values  added  to  each  number  in  the 
series  were  not  constant.  These  values  were  also  in  series  and  included 
both  positive  and  negative  numbers. 

The  figure  used  in  problem  34A,  34B,  34C  and  34D  was  subdivided  into 
36  areas.   Conors  were  also  introduced  into  the  problems.   The  rationale 
underlying  each  solution  is  presented  with  the  problems  in  Appendix  I. 
Again  each  form  was  made  progressively  more  complex. 

The  four  forms  of  problem  36  employed  a  figure  subdivided  into  20  areas. 
Colors  were  used  as  well  as  solid  and  broken,  curved  and  straight  lines. 
The  solution  to  the  four  forms  of  the  problem  was  dependent  upon  associat- 
ing positive  or  negative  letters  with  different  varieties  and  colors  of 
lines.   (Appendix  I).   In  problems  38A  and  B  the  concept  of  symmetry  was 
implied. 

The  rationale  used  to  build  all  the  problems,  as  given  in  Appendix  I 
was  determined  exclusively  by  the  experimenters  who  developed  the  problems. 
We  do  not  claim,  though,  that  this  rationale  will  be  employed  by  all  the 
subjects.   As  a  matter  of  fact,  some  approaches,  of  which  we  were  unaware, 
were  used  with  success  by  the  subjects  in  solving  some  of  the  problems. 

3)  Mid-Testing  Session 

Problems  31C,  35A' ,  32E  and  36E  were  administered  in  the  mid-testing 
session.  The  first  two  problems  are  exactly  the  same  as  31C  and  35A  as  far 
as  schemata  and  type  of  content  are  concerned.  Nevertheless,  as  it  can  be 
seen  in  Appendix  I,  the  specific  content  is  new.   The  same  thing  applies  to 
problems  32E  and  36E. 

4)  Post-Testing  Session 


session.  Problems  31D' ,  35B',  32F  and  36F  follow  the  rationale  explained 
before  for  problems  of  type  a  and  b.   The  problems  themselves  can  be  found 
in  Appendix  I. 

Problem  26  was  a  new  problem,  selected  among  those  that  had  shown 
better  promise  in  a  previous  investigation  (Rimoldi,  Devane,  1961).   It 
could  be  described  in  terms  of  trees  but  when  it  was  developed  we  proceeded 
by  a  process  of  elimination  of  pertinent  information  that  converges  in  the 
final  answer. 


I 
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Problem  41A  refers  to  a  communication  network,  the  graphical  repre- 
sentation of  which  is  given  in  the  matrix  in  Figure  6. 
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Figure  6 


Assume  that  N  and  S  are  two  buildings  in  a  factory.   Building  N  has 
three  offices  A,  B  and  C,  and  building  S  has  five  offices,  D,  E,  F,  G  and 
H,   The  arrows  on  the  right  hand  side  of  the  figure  indicate  the  direction 
in  which  communications  are  effected  between  offices.   Thus,  from  office  B 
it  is  possible  to  initiate  a  call  to  offices  A  and  C.   (Notice  that  from 
A  no  call  can  be  initiated).   The  row  and  column  of  0's  indicate  that 
office  G  can  neither  receive  nor  initiate  a  call. 

The  column  marginals  show  from  how  many  offices  each  office  may  re- 
ceive calls,  i.e.,  .  .  .office  A  can  be  called  from  two  offices,  B  and  E. 
The  row  marginals  indicate  how  many  offices  can  be  contacted  from  a  given 
office,  i.e.,  from  E,  five  offices  can  be  contacted. 

This  schema  can  be  further  complicated  by  increasing  the  number  of 
cells,  by  increasing  the  main  subdivisions  in  the  table,  by  using  a  double 
entry  system  and  so  forth.  As  indicated  in  Appendix  I,  Figure  6  was  used 
in  this  research. 

c)  Administration  Of  The  Froblem 


Problems  1}   19  and  25  as  well  as  Raven's  Progressive  Matrices  and 
Thought  Problems,  Part  I,  were  administered  in  group  form.   No  time  limit 
was  prescribed  for  problems  1,  19  and  25.  The  remaining  tests  were  admini- 
stered according  to  the  specifications  in  the  test  manuals.   Problems  1, 
19  and  25  were  not  reviewed  with  the  exDerimenter  as  it  was  done  in  the 


training  sessions. 

The  training  session  problems  were  administered  individually  in  the 
order  indicated  in  Table  1.   Each  testing  session  lasted  approximately  for 
one  hour. 

The  subject  was  allowed  to  proceed  at  his  own  speed  with  no  time  limit 
given*   The  subject  recorded  the  questions  as  he  asked  them,  and  the  experi- 
menter scored  the  solution  as  right  or  wrong  without  informing  the  subject 
or  passing  any  comments  about  his  performance. 

When  the  problem  was  finished,  the  experimenter  asked  the  subject  to 
evaluate  his  performance  by  examining  each  question  that  he  had  asked  in  the 
order  in  which  he  asked  it.   For  example  ,  the  experimenter  would  say: 
"You  first  asked  item  (card)  number  7 j  why  did  you  select  this  card  and  do 
you  think  it  was  a  good  choice?"  The  subject  then  would  state  his  reasons 
and  talk  freely  about  his  performance,  offering  comments  that  were  recorded 
by  the  experimenter.  This  procedure  was  followed  until  the  subject  had  an 
opportunity  to  comment  on  all  the  choices  he  had  made.  Throughout  these 
sessions  the  experimenter  deliberately  withheld  judgments  that  could  be 
interpreted  as  his  evaluation  of  the  subject's  performance  or  that  could 
be  construed  as  suggestions  for  "better"  approaches.   This  technique  was 
used  in  all  the  problems  administered  during  the  training  sessions. 

The  problems  administered  during  the  mid-testing  session  were  also 
given  individually.   No  review  session  was  performed  here. 

The  post-testing  problems  were  administered  in  group  form.   No  review 
session  took  place.   Thought  Problems,  Part  II,  were  administered  according 
to  the  test  instructions. 

The  control  group  did  not  have  training  sessions  or  mid-testing  session. 
The  pre-  and  post-testing  sessions  were  identical  to  those  for  the  experi- 
mental group. 

The  control  subjects  were  administered  individually  the  Rotter  Incom-, 
plete  Sentences  Blanks  and  the  Rozenweig  Picture.  Frustration  Test,  in  an 
attempt  to  control  for  the  so-called  "Hawthorne"  effect.   Because  of  time 
limitations  and  difficulties  in  scheduling  the  control  college  freshmen, 
only  a  few  of  them  were  administered  these  tests. 
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Chapter  V 
Analyses  Of  The  Data  And  Findings 


a)   Matching  Tests  and  Thought  Problems 

We  shall  analyze  first  the  results  obtained  in  the  pre-  and  post-testing 
sessions  for  both  the  experimental  and  control  groups  of  high  school  and 
college  freshmen. 

Table  2  presents  the  means,  standard  deviations  and  number  of  subjects 
on  which  these  statistics  are  based.  As  expected,  because  of  the  individual 
matching,  there  are  no  differences,  at  an  acceptable  statistical  level,  be- 
tween the  control  and  experimental  group  in  the  means  of  the  Raven's  test 
(college  and  high  school  freshmen),  in  the  Henmon-Nelson  10  Test  (high  school 
freshmen),  or  in  Thought  Problems,  Part  I  (college  freshmen). 

The  comparison  of  the  results  obtained  between  control  and  experimental 
groups  in  Thought  Problems,  Part  I,  in  both  college  and  high  school  freshmen 
show  no  significant  differences,  either  for  means  or  variances.  The 
holds  for  Thought  Problems,  Part  II,  in  the  post-testing  sessions. 


sam; 


The  matched  pair  correlations  are  the  following: 

High  School,  Raven  Test 88 

High  School,  Henmon-Nelson  IQ 98 

College,  Raven  Test 83 

College,  Thought  Problems,  Part  I 88 

These  values  thus  far  reported  are  an  indication  that  the  matching  was 
satisfactorily  performed. 

It  is  interesting  to  note  that  the  matched  pair  correlation  for 
Thought  Problems,  Part  I,  in  high  school  freshmen  is  .44.  This  test  was 
not  used  for  matching  purposes  in  this  group. 

The  intercorrelations  of  the  scores  between  the  tests  used  are  as  shown 
in  Table  3.   All  the  intercorrelations  thus  far  reported  are  all  significant 
at  the  .01  level,  with  the  exception  of  the  intercorrelations  between 
Thought  Problems,  Part  I,  and  the  Henmon-Nelson  IQ  in  high  school  freshmen 
(experimental  group)  and  Raven  Versus  Thought  Problems,  Part  I,  in  college 
freshmen  (experimental  group)  that  are  significant  at  the  .05  level. 

Comparing  the  means  corresponding  to  Thought  Problems,  Part  I  and 
Part  II,  administered  respectively  in  the  pre-  and  post-testing  sessions  it 
is  found  that:   the  increase  in  scores  is  significant  for  both  control  and 
experimental  college  freshmen,  at  the  .001  level;   but  only  for  the  control 
group  among  high  school  freshmen  (.01  level)  and  not  for  the  experimental 
group. 
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Table  3 


Intercorrelations  Between  the  Scores 
of  the  Tests  Used 


High  School 


College 


Experi 
ment 


;ri-f_       lExneri-L     ,1 
tal  Control  ,  mental  pontrolj 


Raven's  vs  Thought  Problems ,  Part  I 
Raven's  vs  IQ  (Henmon-Nelson) 


,56* 


,64* 


,67 


,  49 


.72 


56 


IQ  (Henmon-Nelson)  vs  Thought  Problems,  Part  1   .43*   .55* 


*  The  values  with  an  asterisk  refer  to  intercorrelations  in  which  one 
of  the  tests  was  not  used  for  matching  purposes. 


The  next  analysis  refers  to  the  comparisons  between  high  school  and 
college  freshmen  for  the  control  and  experimental  groups.   The  results  indi- 
cate that  there  is  no  significant  difference  in  Thought  Problems,  Part  I 
Cpre-testing)  between  high  school  and  college  controls  or  high  school  and 
college  experimentals.   That  is,  statistically  considered,  the  high  school 
and  college  groups  are  the  same  at  the  beginning  of  the  experiment. 

At  the  end  of  the  experiment,  these  same  comparisons  show  a  significant 
increase  in  scores  (.01  level),  in  favor  of  the  college  group. 

The  study  of  the  variances  shows  that  for  the  high  school  group,  neither 
the  control  nor  the  experimental  differs  at  any  statistically  acceptable 
level  when  comparing  performances  in  Thought  Problems,  Part  I  and  II.   Never- 
theless, in  the  college  group  the  change  is  significant  at  the  .05  level  for 
the  experimental  and  at  the  .01  level  for  the  control  group.  The  test  here 
used  is  the  t  statistics  for  correlated  variances. 

Summarizing,  in  the  college  group  the  increase  in  scores  is  more  defi- 
nite than  in  the  high  school  sample  and  is  accompanied  by  a  corresponding 
increase  in  homogeneity. 

The  fact  that  the  differences  between  the  means  of  high  school  and 
college  freshmen  are  significant  for  Thought  Problems,  Part  II,  may  be  attri- 
buted to  the  effects  of  a  variety  of  sources,  among  them,  age,  educational 
level,  etc.   We  hope  to  clarify  further  this  point  in  the  following  text. 
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b)  Grades  in  School 

In  Table  4  the  means  and  standard  deviations  of  grades  in  three  sub- 
jects (English,  Latin  and  Algebra)  as  well  as  an  average  grade  are  given 
for  the  control  and  experimental  high  school  freshman.  The  differences  in 
grades  obtained  at  the  mid-year  and  at  the  end  of  the  year  are  given.   These 
differences  are  not  significant.  However,  when  these  differences  are  com- 
pared, that  is,  when  the  changes  for  the  experimental  and  the  control  group 
are  subtracted  it  is  found  that  the  differences  in  changes  are  significant 
at  the  .05  level  for  the  average  grade,  in  favor  of  the  exoerimental  group. 
That  is,  the  gain  in  the  experimental  group  is  greater  than  in  the  control 
group. 


Table  4 

Means  and  Standard  Deviations  of  the  Three  Academic  Subjects 

and  Over-All  Average  of  Mid-Year  and  Final  Grades. 

Mean  Changes  from  Mid-Year  to  Final  Grades, 

and  Differences  in  Changes 

for  Experimental  and  Control  Groups 

in  High  School  Freshmen. 


\\  iiDiffer-  I 

Experimental  Control  !  ence  in 

T      I  i  ii  urn  ■ ill ill  

Mid-Year   |       Final        'Changes'  Mid-Year    ■,       Final       |  Changesj       Mean     i 

M         a  M         cr      ■'    in  M  M         c  M         a      :    in  M     i    Change  i 

I       '  ' T — '  1 1        — *— 

[English  ,84.37   6.35J84.12   7.46  j-    .25      ,36.00    6.87184.92   7.42    -1.08      jj         .83     | 

L 1 _ 1 L [| 1 

Latin        82.61   7.4583.87   5.64-    1.26      |i84.96   8.23  85.09   7.53        .13     ,        1.13     I 

! I i , il j i 

i  i         ■  i       i  '  *  n  *  ■) 

Algebra  ,81.17   7.51    81.83   6.66,;      .65     IJ83.91   6.90   84.78  6.52;       .87      I     -    .22     j 


J|A 


verage  '82.33  5.92;83.69   6.24  j    1.36      l;84.71    6.0284.77    5.64        !o6     jl      1.30* 

, , y i l! 

*p  <^  .05   (t   test) 

1  The  average  was  based  on  five  academic  subjects  beyond  those  listed  here. 


. 
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c)  Group  Performance  in  the  Problem 

1)  Number  of  Cards 

As  described  elsewhere,  this  score  consists  essentially  in  the  number 
of  cards  chosen  by  each  subject  in  order  to  solve  the  problem.   It  is  assumed 
that  number  of  cards  is  partially  a  function  of  efficiency  in  interpreting 
information  and  asking  questions.   Other  factors  may  also  enter  in  this  type 
of  score  (Rimoldi,  Devane,  Grib,  1958). 

Tables  5  and  6  show  the  means  and  standard  deviations  of  number  of  cards 
for  each  problem  administered  during  the  training  sessions  for  high  school 
and  college  freshmen  respectively. 

Table  7  gives  the  same  statistics  without  differentiating  the  training 
sessions  in  which  the  problems  were  administered. 

According  to  our  design,  problems  of  type  a  were  administered  first  to 
group  a,  and  problems  of  type  b  to  group  b,  so  that  in  the  second  training 
session,  subjects  of  group  a  were  given  problems  of  type  b,  and  subjects  of 
group  b  were  given  problems  of  type  a.  Thus,  if  there  is  transfer  from  one 
type  of  problem  to  the  other  type,  a  change  in  the  corresponding  statistics 
should  be  observable. 

By  comparing  mean  number  of  cards  in  college  freshmen  for  type  a  prob- 
lems in  the  first  session  and  type  a  problems  in  the  second  session  (when  the 
subjects  had  already  been  trained  in  problems  of  type  b)  it  is  found  that,  in 

11  out  of  14  problems,  there  is  a  decrement  in  the  number  of  cards  used  in 
group  b.   This  over-all  change  is  significant  (one  tailed  binomial  test)  at 
the  .029  level.  When  studying  the  group  that  received,  in  the  first  training 
sessions,  problems  of  type  b  with  those  who  received  problems  of  type  b  in 
the  second  session,  that  is  after  having  had  training  in  problems  of  type  a, 
it  is  found  that  in  11  out  of  14  problems  there  is  a  decrement  in  the  number 
of  cards  used.  Again,  this  is  significant  at  the  .029  level. 

The  previous  data  refers  to  college  freshmen  (Table  6).   For  high  school 
freshmen,  we  found  that  in  problems  of  type  a,  9  out  of  10  increase  the  mean 
number  of  cards  (two  problems  have  exactly  the  same  mean)  after  having  had 
training  with  problems  of  type  b.   For  problems  of  type  b,  10  out  of  12  de- 
crease the  mean  number  of  questions  used  after  having  had  training  with  prob- 
lems of  type  a.   This  last  set  of  values  is  significant  at  the  .019  level 
(binomial  test).  The  corresponding  data  is  presented  in  Table  5. 

In  summary,  studying  the  total  groups  of  college  and  high  school  fresh- 
men, it  is  found  that  the  number  of  questions  asked  in  the  second  training 
session  in  problems  of  type  a,  when  compared  with  the  number  of  questions 
asked  in  the  first  training  session  in  the  same  type  of  problems,  is  less  in 

12  out  of  24  cases.   When  performing  the  3ame  operation  for  the  type  b  prob- 
lems it  is  found  that  the  number  of  questions  is  less  in  21  out  of  26  cases. 
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Table   5 


Mean  and  Standard   Deviation  of  Number  of  Questions, 
Number  of  Subjects  Completing,   and  Number  of  Subjects  Obtaining 
Correct  Solutions   for  Each  of   the  Twenty-Four  Training  Problems 
in  Group   a  and  b  of   the  High  School  Freshmen 


Problems 

Gr 

oup  a 

Problems 

Group  b 

Type   a 

M 

o 

N  of 
Subjects 

Correct 
Solution 

Type  b 

M 

0 

N   of 
Subjects 

Correct 
Solution 

31  A 

3.77 

..97 

13 

12 

32  A 

15.00 

2.96 

13 

11 

B 

6.38 

1.86 

13 

7 

B 

14.92 

3.81 

13 

12 

C 

5.46 

2.21 

13 

6 

C 

14.85 

3.96 

13 

9 

D 

5.92 

1.44 

13 

6 

D 

15.38 

2.98 

13 

10 

33  A 

6.54 

1.99 

13 

10 

34  A 

20.15 

8.78 

15 

11 

B 

7.23 

1.89 

13 

9 

3 

18.62 

5.33 

13 

12 

C 

6.54 

2.10 

13 

10 

!      c 

14.69 

7.24 

13 

12 

D 

6.08 

1.86 

13 

12 

D 

17.54 

4.05 

13 

8 

35  A 

5.61 

1.39 

15 

11 

36  A 

16.15 

4.00 

15 

3 

B 

7.31 

2.95 

13 

8 

B 

12.85 

5.43 

13 

9 

C 

5.83 

1.46 

12 

7 

C 

12.00 

5.96 

15 

3 

D 

6.23 

1.97 

13 

9 

D 

11.42 

5.68 

12 

5 

Type  b 

10.69 

3.07 

13 

13 

Type   a 

3.77 

.80 

13 

12 

32  A 

31  A 

B 

10.83 

3.26 

12 

11 

B 

5.92 

1.86 

15 

6 

C 

11.75 

3.65 

12 

11 

C 

6.69 

2.58 

13 

3 

D 

14.33 

3.64 

12 

2 

D 

5.92 

1.69 

15 

5 

34  A 

15.62 

6.37 

13 

13 

33  A 

8.23 

2.01 

15 

8 

B 

19.38 

5.97 

13 

12 

B 

9.46 

2.06 

13 

10 

C 

15.31 

5.86 

13 

11 

C 

7.69 

1.77 

13 

10 

D 

16.62 

6.17 

13 

11 

D 

7.54 

2.37 

13 

12 

36  A 

14.00 

4.21 

13 

2 

55  A 

6.00 

1.68 

12 

10 

B 

11.46 

4.53 

13 

10 

B 

8.69 

3.05 

13 

7 

C 

11.77 

5.44 

13 

5 

c 

8.08 

3.00 

13 

11 

D 

10.00 

5.97 

13 

5 

D 

7.15 

2.96 

13 

11 
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Table  6 


Mean  and  Standard  Deviations  of  Number  of  Quest ions , 
Number  of  Subjects  Completing,  and  Number  of  Subjects  Obtaining 
Correct  Solutions  for  Each  of  the  Twenty-Eight  Training  Problems 
in  Grovp  a  and  b  of  the  College  Freshmen 


Problems 

i 

Group  a 

Problems 

Group  b 

Type  a 

M 

O 

N  of 
Subjects 

Correct 
Solution 

F 

Type  b 

H 

0 

N  of 
Subjects 

Correct' 
Solution 

t 

i   31  A 

3.75 

.72 

12 

12 

32  A 

10.92 

2.36 

12 

8 

B 

5.25 

1.92 

12 

6 

B 

10.33 

3.79 

12 

12 

C 

4.75 

.92 

12 

7 

C 

11.00 

2.94 

12 

12 

D 

4.50 

1.04 

12 

6 

D 

13.42 

3.90 

12 

8 

1   33  A 

5.75 

1.83 

12 

12 

34  A 

13.73 

5.96 

11 

10 

B 

6.75 

1.36 

12 

11 

B 

15.00 

3.95 

11 

11 

c 

6.83 

1.77 

12 

11 

C 

15.00 

3.44 

11 

10 

D 

5.67 

1.80 

12 

11 

D 

14.18 

4.26 

11 

11 

35  A 

6.00 

1.73 

12 

12 

36  A 

15.45 

4.52 

11 

3 

B 

6.50 

2.25 

12 

9 

B 

11.09 

5.47 

11 

7 

C 

6.25 

1.64 

12 

11 

C 

3.36 

5.38 

11 

9 

D 

6.17 

1.52 

12 

12 

D 

4,00 

1.54 

11 

11 

37  A 

6.92 

1.66 

12 

7 

38  A 

24.82 

4.95 

11 

11    1 

B 

7.75 

1.01 

12 

12 

B 

25.09 

7.01 

11 

9 

Type  b 

11.60 

3.10 

10 

- 
10 

Type  a 

3.82 

.83 

10 

32  A 

31  A 

B 

9.70 

2.19 

10 

9 

B 

4.91 

2.06 

6 

C 

11.70 

2.45 

10 

9 

c 

3.36 

.64 

7 

1      ° 

11.70 

3.52 

10 

8 

D 

4.09 

.79 

10 

34  A 

13.40 

4.25 

10 

8 

33  A 

4.64 

.77 

9 

B 

11.90 

2.77 

10 

10 

B 

7.00 

2.17 

9 

1      C 

10.90 

2.81 

10 

9 

5.54 

1.78 

11 

D 

12.50 

2.33 

10 

10 

D 

5.64 

1.97 

10 

36  A 

13.10 

5.39 

10 

5 

35  A 

5.36 

.88 

11 

B 

9.10 

4.61 

10 

5 

B 

6.09 

1.78 

9 

C 

5.44 

1.34 

9 

8 

c 

5.00 

0 

11 

D 

4.44 

1.16 

9 

9 

D 

5.00 

.43 

11 

38  A 

17.00 

6.74 

8 

7 

37  A 

7.09 

1.73 

7 

B 

19.62 

7.94 

8 

7 

i 
i 

B 

7.00 

1.65 

9 

25  - 


Table  7 


Mean  and  Standard  Deviations  of  Number  of  Questions, 
Number  of  Subjects  Completing,  and  Number  of  Subjects  Obtaining 
Correct  Solutions  for  Each  One  of  the  Training  Problems 
in  High  School  and  College  Freshmen 


|  Problems 

High 

School 

College 

1  Type  a 

M 

c 

N  of 
Subjects 

Correct 
Solution 

1    M 

o 

N  of 
Subjects 

Correct 
Solution 

31 

A 

3.77 

.89 

26 

24 

3.78 

.78 

23 

22 

B 

6.15 

1.88 

26 

13 

5.09 

2.00 

23 

12 

; 

C 

6.07 

2.48 

26 

9 

4.09 

1.06 

23 

14 

i 

D 

5.92 

1.57 

26 

11 

4.30 

.95 

23 

16 

1   33 

A 

7.38 

2.17 

26 

18 

5.22 

1.53 

23 

21 

1 

B 

8.34 

2.27 

26 

19 

6.87 

1.80 

23 

20 

C 

7.11 

2.03 

26 

20 

6.22 

1.89 

23 

22 

D 

6.81 

2.25 

26 

24 

5.65 

1.88 

23 

21 

35 

A 

5.80 

1.55 

25 

21 

5.70 

1.43 

23 

23 

B 

8.00 

3.08 

26 

15 

6.30 

2.05 

23 

18 

C 

7.00 

2.64 

25 

18 

5.65 

1.34 

23 

22 

D 

6.70 

2.55 

26 

20 

5.61 

1.28 

25 

23 

37 

A 

7.00 

1.69 

25 

14 

: 

B 

7.39 

1.41 

23 

21 

Typ 

2  b 

12.85 

3.71 

26 

24 

11.23 

2.75 

22 

18 

32 

A 

B 

12.96 

4.10 

25 

23 

10.04 

3.18 

22 

21 

c 

13.36 

4.12 

25 

18 

11.32 

2.75 

22 

21 

D 

14.88 

3.35 

25 

12 

12.64 

3.83 

22 

16 

34 

A 

17.88 

8.00 

26 

24 

13.57 

5.22 

21 

18 

B 

19.00 

5.67 

26 

24 

13.52 

3.77 

21 

21 

c 

15.00 

6.59 

26 

23 

13.05 

3.76 

21 

19 

D 

17.08 

5.72 

26 

19 

14.05 

2.01 

21 

21 

36 

A 

15.08 

4.24 

26 

5 

14.33 

5.09 

21 

8 

i 

B 

12.15 

5.05 

26 

19 

10.14 

5.17 

21 

12 

» 
1 

C 

11.88 

5.71 

26 

8 

7.05 

4.68 

20 

17 

D 

10.68 

5.88 

25 

10 

4.20 

1.40 

20 

20 

38 

A 

21.53 

6.95 

19 

18 

1 
I 

B 

22.79 

7.89 

19 

16 
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Since,  in  the  first  case,  subjects  had  been  trained  in  type  b  problems  and, 
in  the  second  case,  they  had  been  trained  in  type  a  problems,  it  seems 
reasonable  to  -onclude  that  training  in  type  a  problems  increases  the  effi- 
ciency of  solving  type  b  problems  more  than  type  b  problems  increase  the 
efficiency  of  solving  type  a  problems.   In  fact,  the  high  school  freshmen 
that  had  been  trained  with  problems  of  type  b,  instead  of  decreasing,  asked 
more  questions  in  9  out  of  10  cases  (two  cases  being  the  same).  This  is 
difficult  to  explain  unless  the  idea  of  a  negative  transfer  is  offered.  At 
first  examination  this  does  not  seem  too  logical.  Other  reasons  may  also  be 
brought  forth,  such  as  age  of  the  subjects,  testing  conditions,  interests  of 
the  member  of  the  sample,  educational  level,  etc. 

The  means  and  standard  deviations  of  the  number  of  cards  used  in  the 
mid-testing  session  are  presented  in  Table  8. 

Subjects  who  had  been  trained  in  problems  of  type  a  selected  fewer 
cards  in  problems  of  type  a  than  subjects  who  had  been  trained  with  type  b 
problems.  This  holds  both  for  the  high  school  and  college  freshmen.   In 
all  cases,  with  the  exception  of  problem  55A*  in  college  freshmen,  the  sig- 
nificance level  of  the  difference  is  .05  or  better.   This  can  be  seen  by  in- 
specting the  t  values  in  Tables  8  and  9. 

Similar  results  are  obtained  comparing  the  number  of  questions  used  by 
subjects  that  have  been  trained  in  problems  of  type  b,  with  those  that  have 
been  trained  in  problems  of  type  a,  when  the  mid-test  problem  is  of  type  b. 
The  results  show  that  the  differences  are  significant  for  both  high  school 
and  collage  freshmen  at  the  .05  level  or  better  in  problem  36E  (see  t  values 
in  Tables  8  and  9).   This  does  not  occur  for  problem  32E,  where  the  differ- 
ences are  not  significant. 

Similarly,  the  inspection  of  the  standard  deviation  corresponding  to 
number  of  questions  asked  indicates  that  when  the  problem  used  for  mid- 
testing  is  of  the  same  type  as  the  problems  used  in  the  training  sessions, 
the  variance  is  smaller,  with  the  exception  of  problem  36E  in  high  school 
students. 

It  may  then  be  suspected  that  training  in  one  type  of  problem  is  highly 
effective  in  problems  of  the  same  type  in  economy  of  questions  asked  and  in 
reducing  individual  variations  in  number  of  questions  asked,  with  the  excep- 
tions listed  in  the  text. 

The  final  testing  session  included  both  control  and  experimental  groups 
in  problems  1,  19  and  25  (that  were  the  same  in  the  pre-  and  post-testing 
sessions),  problems  26  and  41A  that  were  entirely  new,  and  problems  31D', 
35B' ,  32F  and  36F. 

The  experimental  group  performance  in  the  last  four  tests  mentioned 
will  be  analyzed  first.  By  looking  at  Tables  10  and  11,  it  is  clear  that 
the  differences  between  the  mean  number  of  cards  used  is  not  significant. 
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Table  8 


Mean  and  Standard  Deviation  of  Number  of  Questions, 
Number  of  Subjects  Completing,  and  Number  of  Subjects  Obtaining 
Correct  Solutions  for  Each  One  of  the  Four  Mid-Testing  Problems 
of  the  High  School  Freshmen 


Problemsi 

Group   a 

i 
i 

G 

roup  b 

Type   a  1      M 

i 

o 

N  of 
Subjects 

Correct  ; 
Solution  1 

M 

c 

N   of 
Subjects 

Correcti 
Solutionj 

"t"  value 

1 
31   C    j     5.31 
35  A'    j     6.00 

1.54 
.96 

13 
13 

i 
7          1 
9          I 

| 

7.62 
9.23 

2.34 
2.26 

13 
13 

2        i 
10        j 

2.86xx 
4.56xxx 

Type  b  [ 

3.73 

3.97 

13 
13 

I 
8 

1          I 

12.85 
11.00 

3.74 
5.88 

13 

13 

10        j 
6        | 

I 

32  E      1  12.69 
36  E     [  14.62 

-   .10 
1.77* 

x  p<  .05 

**  p^r'.Ol 

xxx  p<C  .001 

Table  9 

Mean  and  Standard  Deviation  of  Number  of  Questions, 
Number  of  Subjects  Completing,  and  Number  of  Subjects  Obtaining 
Correct  Solutions  for  Each  One  of  the  Four  Mid-Testing  Problems 
of  the  College  Freshmen 


Problems: 

Group   a 

Group  b 

I 

Type   a 

M 

a 

N   of 
Subjects 

Correct  j 
Solution 

M 

a 

N   of 
Subjects 

Correct! 
Solution 

31  c  : 
35  A' 

4.50 
6.25 

1.04 
1.36 

12 

1? 

7 
12          I 
I 

5.91 

7.54 

2.19 
2.61 

11 
11 

3 
9 

Type   b  ; 

9.75 
11.58 

4.06 
4.05 

12 
12 

i 
I 

3     i 

2 

9.63 
5.09 

2.19 
2.57 

11 

11 

6 
11 

32  E     | 
36  E     ; 

.05 
.001 


"t"  value 


,96* 

.47 


.09 
4.63xxx 
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Table  10 


Mean  and  Standard  Deviation  of  Number  of  Questions, 
Number  of  Subjects  Completing,  and  Number  of  Subjects  Obtaining 
Correct  Solutions  for  Each  One  of  the  Four  Final -Testing  Problems 
of  the  High  School  Freshmen 


Problemsi 

Group  a 

Group  b 

1 

1 
Type  a  { 

M 

c 

N  of 
Subjects 

Correct 
Solution 

M 

c 

N  of 
Subjects 

Correctj 

Solution! 

31  D' 
35  B'  j 

4.23 
5.92 

1.67 
1.64 

13 
13 

11 

7 

:  4.85 
1  6.75 

1.51 
2.42 

13 
12 

| 

11   ! 
8 

Type  b  j 

15.15 
9.46 

4.38 
5.54 

13 
13 

7 
9 

■  14.69 
1  8.85 

3.07 
5.75 

13 
13 

7   ! 
11    1 

32  F 

36  F  '' 

,95 
.97 


31 
.6 


Table  11 

Mean  and  Standard  Deviation   of  Number  of  Questions, 
Number  of  Subjects  Completing,  and  Number  of  Subjects  Obtaining 
Correct  Solutions  for  Each  One  of  the  Four  Final-Testing  Problems 
of  the  College  Freshmen 


Problems; 


Group  a 


Group  b 


Type  a 


N  of    Correct 
Subjects  Solution 


31  D' 
35  B* 


3.38 
5.88 


.78 

1.69 


3.82 
5.91 


.86 
1.24 


N  of  Correct 

Subjects  Solution 

11  10 

11  11 


Type  b 

32  F 
36  F 


14.12 
5.38 


3.35 
2.34 


(14.00 
i  5.09 


2.73 
4.23 


11 
11 


7 
10 


't"  value 

.14 
.05 


.08 
.13 
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The  fact  that  at  this  post-testing  session,  none  of  the  pairs  of  means  show 
significant  differences  is  highly  remarkable  when  interpreted  in  terms  of  the 
findings  given  in  Tables  8  and  9,  that  correspond  to  the  mid-test  session. 
As  it  will  be  remembered,  the  general  conclusion  was  that  training  in  one  type 
of  problems  is  effective  in  performance  in  the  same  tyoe  of  problem.   From 
the  comparisons  indicated  in  Tables  10  and  11,  we  can  assume  that  this  con- 
clusion is  further  strengthened,  in  the  sense  that  at  the  final  stage  of  the 
experiment  all  the  subjects  had  received  training  in  both  types  of  problems. 
Therefore,  if  the  previous  conclusions  were  acceptable,  the  results  of  the 
final  testing  should  indicate  no  differences.  Also,  at  this  etage  in  the 
experiment,  it  matters  little  whether  problems  of  type  a  or  type  b  were  given 
first,  that  is,  within  the  experimental  limitations  imposed  by  our  design, 
order  of  administration  of  problems  seems  to  be  irrelevant,  since  none  of  the 
comparisons  is  statistically  significant  at  an  acceptable  level. 

It  is  interesting  that  when  the  means  and  standard  deviations  of  corre- 
sponding tests  in  Tables  10  and  11  are  compared  for  both  high  school  and 
college  freshmen,  the  general  trend  is  that  high  school  freshmen  use  more 
questions  than  college  freshmen,  and  also  have  higher  variances.   The  differ- 
ence between  means  is  significant  for  test  36F  (one  tail  test)  at  the  .05 
level . 

The  variances  for  the  high  school  freshmen  are  higher  than  those  for 
the  college  freshmen,  reaching  the  .05  level  of  significance  for  problem  31D* . 
For  problems  35B*  and  36F,  the  same  thing  happens  for  groups  b  and  a  respec- 
tively. 

In  summary,  the  trend  indicates  that  college  freshmen  ask  less  questions 
and  are  more  homogeneous  than  high  school  students.   This  may  be  an  interest- 
ing hint  deserving  further  exploration  as  to  the  advantages  and  possibilities 
of  training  in  problem  solving  at  different  ages  and  educational  levels. 

In  Table:;  12  and  13  we  present  the  same  type  of  data  for  both  control 
and  experimental  groups  in  Tests  1,  19  and  25  at  the  ore-  and  post-testing 
sessions,  as  well  as  for  problems  31D' ,  35B',  32F,  36F,  26  and  41A. 

Concerning  problems  that  were  administered  both  at  the  pre-  and  post- 
testing  session  to  both  experimental  and  control  groups,  it  is  found  that 
there  is  no  difference  for  the  high  school  freshmen  (Table  12)  in  the  mean 
number  of  cards  chosen  in  problems  1,  19  and  25.   For  the  college  students 
in  problem  19,  pre-testing,  the  control  group  selects  more  cards  than  the 
experimental  group.   The  difference  is  significant  at  the  .05  level.   Compar- 
ing now  the  number  of  cards  chosen  by  the  same  subjects  in  problems  1,  19 
and  25  in  both  the  pre-testing  and  post-testing  sessions,  it  is  found  that 
for  high  school  students  the  only  differences  that  are  significant  correspond 
to  problem  1  at  the  .001  level  in  the  control  group  and  the  .05  level  in  the 
experimental  group,  the  mean  number  of  cards  in  both  cases  being  higher  in 
the  pre-testing  session.   In  the  college  freshmen,  comparing  pre-  and  post- 
testing  sessions,  it  is  found  that  in  the  control  group  there  is  a  decrement 
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Table  12 


Mean  and  Standard  Deviation  of  Number  of  Questions 

Number  of  Subjects  Completing,  and  Number  of  Subjects  Obtaining 

Correct   Solutions   for  Each  One   of   the  Pre-Testing   and  Post-Testing  Problems 

in  Control  and  Experimental  Groups  of  High  School  Freshmen 


Problems 

Control 

Exper: 

.mental 

M 

0 

N 

Correct 

Solution 

M 

C 

N 

Correct  j 
Solution 

1 

4.04 

1.60 

26 

24 

1  4.08 

1.96 

26 

25   ; 

Pre-Testing 

19 

8.08 

2.97 

26 

15    j 

8.28 

2.52 

25 

16 

25 

7.31 

3.75 

26 

19 

1  6.81 

2.54 

26 

22 

| 

1 

2.96 

.68 

24 

24   | 

1 

j  3.27 

1.29 

26 

! 

25 

Post-Testing 

19 

8.21 

2.61 

24 

18    1 

1  8.38 

1.99 

26 

22 

25 

6.29 

2.05 

24 

22 

;  6.77 

2.15 

26 

23 

31D' 

5.92 

2.14 

24 

5    1 

4.54 

1.62 

26 

22 

Type  a 

35B' 

7.88 

2.18 

24 

9    i 

6.32 

2.09 

25 

15 

i 

32F 

15.46 

2.78 

24 

12 

;  14.92 

3.79 

26 

14 

1   Type  b 

36F 

13.75 

4.26 

24 

2 

|  9.15 

5.65 

26 

20 

i 
I 
!  New  Problems 

1 

26 
41A 

7.96 
7.04 

2.19 
2.30 

24 
24 

9 
12 

j  7 .  35 
5.65 

2.34 
1.80 

26 
25 

14 
19 

"t"  value* 

.08 
.16 

.31 

1.23 

1.11 

.70 


,52** 
,63** 

,72 
71*** 

,83 
,20* 


.05 
.01 
.001 


The  "t"  values  were  computed  for  correlated  means  (matched  pairs). 


. 
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Table  13 


Mean  and  Standard  Deviation  of  Number  of  Questions, 
Number  of  Subjects  Completing,  and  Number  of  Subjects  Obtaining 
Correct  Solutions  for  Each  One  of  the  Pre-Testing  and  Post-Testing  Problems 
in  Control  and  Experimental  Groups  of  College  Freshmen 


Cont 

rol 

Experimental 

Problems 

M            o 

N 

Correct 
Solution 

M             C 

N     Correct 
Solution 

"fvaluel 

1 

3.087       .8295 

23 

22 

3.167    1.213 

24 

23 

-   .50 

Pre-Testing 

19 

9.000    2.485 

23 

20 

7.458    1.756 

24 

17 

2.52* 

1 

25 

6.348    2.277 

23 

18       : 

5.333    1.675 

24 

23 

1.76 

1 

2.739      .6056 

23 

21 

2.474      .5955 

19 

18 

1.55 

Post-Testing 

19 

7.870    1.7271 

23 

17 

1   7.526    1.2296 

19 

16 

.0 

25 

5.217    1.1018 

23 

19 

i 

4.737    1.0178 

19 

16 

.39 

Type   a 

31D' 
35B* 

5.565   2.102 
7.478    2.282 

23 
23 

l 
7        i 

9      ! 

3.842       .8120 
5.895    1.447 

19 
19 

18 
18 

3.24** 
2.20* 

Type   b 

32F 

14.478    2.652 

2  3 

10        | 

14.053    2.9995 

19 

13 

1.12 

36F 

14.478    3.335 

23 

3         I 

5.211    3.562 

19 

18 

7.10*** 

New 

26 

7.783   1.817 

23 

9 

6.158    1.694 

19 

ii 

3. 32** 

Problems 

41A 

6.56  5    1.907 

23 

19 

5.053    1.637 
-   ... 

19 

18 

2.62** 

*p<:  .05 
**p  <^.oi 

***p  <^.001 


The  "t"  values  were  computed  for  correlated  means  (matched  pairs) 
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in  the  mean  number  of  cards  chosen  and  that  this  value  is  significant  at  the 
.05  level  in  problems  1,  19  and  25.   In  the  experimental  group,  the  differ- 
ence is  significant  at  the  .05  level  only  for  problem  1,  while  for  problem 
19,  the  difference  is  in  the  opposite  direction.   The  variances  for  both 
college  and  high  school  freshmen,  whether  they  belong  to  the  control  or 
experimental  group ,  are  always  smaller  at  the  post -testing  session. 

The  over-all  conclusions  seem  to  point  to  the  fact  that  in  terms  of 
these  statistics  there  are  not  enough  grounds  to  assume  that  the  training 
sessions  have  had  an  effect  in  the  experimental  group  when  compared  with 
the  control  group.  Nevertheless,  the  control  group  received  oroblems  1,  19, 
and  25  at  the  beginning  of  the  experiment  and  had  no  further  training  (ex- 
cept for  the  Rosenweig  and  Rotter  problems).   It  might  be  conceivable  that 
while  subjects  in  the  control  group  remembered  the  problems,  those  in  the 
experimental  group,  who  had  a  large  number  of  similar  problems  administered 
between  the  pre-  and  post-testing  sessions,  forgot  them.   This  may  be  par- 
tially verified  if  the  comparison  of  the  control  and  experimental  groups 
is  performed  for  tests  that  are  entirely  new  for  both  groups. 

Problems  31D' ,  35B',  are  of  type  a,  while  32F  and  36F  are  of  type  b. 
If  our  assumptions  are  correct  then  the  subjects  of  the  control  group  should 
use  more  questions  than  those  in  the  experimental  group  in  the  solution  of 
these  problems.   This  trend  is  clearly  seen  in  Tables  12  and  13  for  high 
school  and  college  freshmen,  respectively.   The  differences  are  significant 
in  all  cases  at  least  at  the  .01  level  (see  t  values  in  Tables  12  and  13), 
the  only  exceptions  being  problems  32F,  where  the  difference  is  not  signifi- 
cant though  in  the  hypothesized  direction,  and  35B',  college  group,  where 
the  difference  is  at  the  .05  level. 

Problem  32F  (as  presented  in  Appendix  I)  has  the  same  presentation  as 
that  of  problem  32,  but  a  drastic  change  was  introduced  in  the  schema.  As 
it  were,  the  series  in  problems  32  A,  B,  C  and  D,  move  along  the  rows, 
while  the  series  in  32F  move  along  the  columns.   Experimental  subjects  had 
been  trained  in  problems  32  and  then  confronted  with  the  same  figure  but  a 
schema  that  moved  along  a  different  dimension.  This  may  explain  the  results 
obtained. 

As  far  as  the  variances  are  concerned,  only  in  problems  of  type  a  is 
there  more  homogeneity  among  the  experimental  than  among  the  control  sub- 
jects. This  is  only  significant  for  problems  31D'  and  35B'  among  college 
students  (.001  for  problem  31D'  and  .05  for  problem  35B'). 

For  problems  26  and  41A,  that  were  entirely  new,  it  is  found  (Tables  12 
and  13)  that  the  control  group  in  all  cases  uses  more  cards  than  the  experi- 
mental group.  As  indicated  by  the  t  test  these  differences  are  significant 
at  the  .01  level  for  both  problems  in  the  college  freshmen,  and  at  the  .05 
level  for  problem  41A  in  the  high  school  freshmen. 
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The  same  general  trend  is  observed  for  the  variances,  that  is,  control 
subjects  are  more  heterogeneous  than  experimental  subjects  in  all  the  tests, 
the  only  violator  of  this  general  trend  being  again  problem  26,  at  the  high 
school  level. 

Summarizing,  it  seems  that: 

a)  High  school  freshmen  change  less  in  their  observable  behavior  than 
college  freshmen.   The  implications  of  this  will  be  discussed  later. 

b)  Training  is  more  effective  when  problems  of  type  a  are  used  than 
when  problems  of  type  b  are  used,  as  shown  by  the  improvement  in 
problems  31D'  and  35B'. 

c)  In  entirely  new  problems  (26  and  41A)  experimental  subjects  perform 
"better"  than  control  subjects  (The  case  of  problem  26  seems  to  be 
an  exception  to  this  trend  only  for  the  high  school  freshmen.  But 
here  several  causes  may  be  responsible,  such  as  the  fact  that  high 
school  freshmen  are  less  susceptible  to  changes  and  that  the  struc- 
ture of  problem  26  is  less  clear.). 

d)  For  problems  1,  19  and  25,  remembering  may  play  a  significant  part 
in  the  results. 

e)  In  general ,  performance  in  the  experimental  group  is  more  homo- 
geneous than  in  the  control  group. 


2)   Correct  Answers 

Performance  in  each  problem  and  for  each  subject  can  be  evaluated  con- 
sidering whether  the  problem  has  been  solved  correctly.  This  score  is  easy 
to  obtain. 

In  Tables  5  and  6  the  number  of  correct  solutions  for  each  problem  ad- 
ministered during  the  training  period  are  presented.   The  total  values 
are  presented  in  Tables  14  and  15. 

The  proportion  of  correct  solutions  does  not  change  significantly  for 
problems  of  type  a  when  training  with  problems  of  type  b  has  taken  place 
and  similarly,  for  problems  of  type  b.   Nevertheless,  there  are  changes,  al- 
ready discussed,  in  number  of  questions  used.  This  seems  to  enhance  the 
likelihood  of  our  suggestion  that  the  correct  solution  of  a  problem  and  the 
process  followed  to  reach  this  solution  are  not  necessarily  related. 

Tables  8  and  9  give  the  number  of  correct  solutions  in  the  mid-test 
sessions.  For  the  problems  used  during  the  mid-test  session  it  was  found, 
using  Fisher's  exact  probability  test  that:   problems  35A'  and  32E  do  not 
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show  any  significant  change,  at  least  at  the  .05  level,  for  either  high 
school  or  college  freshmen.   Remembering  that  problem  35A'  is  a  type  a 
problem  and  32E  a  type  b  problem,  these  results  suggest  that  whether  the 
training  was  in  type  a  problems  or  type  b  problems,  this  training  did  not 
carry  over  in  any  significant  manner  to  correctness  of  the  solution  in  prob- 
lems 35A'  and  32E.  However,  for  problem  36E,  the  number  of  correct  solu- 
tions is  greater  in  those  subjects,  either  high  school  or  college  freshmen, 
that  had  been  trained  in  type  b  problems.  The  value  of  Fisher's  exact 
probabilities  are  respectively  .036  and  .00005.   In  problem  31C ,  it  is 
found  that  for  high  school  students  the  change  is  significant  at  the  .048 
level.  That  is,  those  subjects  that  were  trained  in  type  a  performed  better 
than  those  trained  in  type  b. 


Table  14 

Total  Values  for  the  Number  of  Correct  Solutions 
in  the  Training  Sessions 
for  High  School  Freshmen 


Group  a 


Group  b 


Problems  I  Total  Number  I  Correct  j   *  I  Total  Number 
of  Problems  ISolutions   *   !  of  Problems 


Correct  j 
Solutions1 


Type  a 


155 


107 


.690  I 


155 


105 


.677 


Type  b 


153 


106 


,693 


155 


105    | .677 


*  P.  means  proportion  of  correct  solutions. 


Table  15 


Total  Values  for  the  Number  of  Correct  Solutions 

in  the  Training  Sessions 

for  College  Freshmen 


Problems 

Group  a 

Group  b 

1 

j Total  Number 
1  of  Problems 

Correct 
Solutions 

P.  * 

Total  Number 
of  Problems 

Correct 
Solutions 

* 

P. 

Type  a 

168 

139 

.827 

154 

130 

.844  ! 

I 

Type  b 

134 

114 

1 1 

.851 

i 

158 

132 

.835 

*  P.  means  proportion  of  correct  solutions. 
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Table   16 


Chi  Square   or  Fisher's  Exact  Probability  Test   for 
Number  of  Correct  Solutions   in  the  Post -Testing  Problems   for  Control 
and  Experimental  Groups   in  High   School   Freshmen 


1 

Problems 

Control 

Experimental 

X^ 

Fisher' s 
Exact 

Correct 

Wrong 

Correct 

Wrong 

Solution 

Solution 

Solution 

Solution 

Probabil  ity 

1 

24 

0 

25 

1 

.520 

19 

18 

6 

22 

4 

.245 

25 

22 

2 

23 

3 

.539 

j    31D* 

5 

19 

22 

4 

17.952*** 

1    55B' 

9 

15 

15 

10 

1.696 

1    32F 

12 

12 

16 

10 

.287 

36F 

2 

22 

20 

6 

21.126*** 

i 

26 

9 

15 

14 

12 

.765 

1 

41A 

12 

12 

19 

6 

1.660 

! 

M?  < 


.05 

.01 
,001 


Table   17 


Chi  Square   or  Fisher's  Exact  Probability  Test   for 
Number  of   Correct   Solutions   in  the  Post-Testing  Problems  for  Control 
and  Experimental  Groups   in  College  Freshmen 


Control 


Exoerimental 


Problems  : Correct  i  Wrong  .  Correct  |  Wrong  j 
.Solution  i  Solution!  Solution)  Solution! 


Fisher' 

Exact 

Probabil 


ity 


1 

21 

2 

18 

1 

.573 

19 

17 

6 

16 

3 

.336 

25 

19 

4 

16 

3 

.612 

31D* 

7 

16 

18 

1 

15.287*** 

35B' 

9 

14 

18 

1 

11.695*** 

32F 

10 

13 

13 

6 

1.703 

36F 

3 

20 

18 

1 

24.604*** 

26 

9 

14 

11 

8 

.812 

41A 

19 

4 

18 

1 

.237 

<  .05 

<.01 

<  .001 
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Simple  inspection  of  Tables  10  and  11  indicates  that  the  final  test 
problems,  31D' ,  35B '  ,  32F  and  36F,  do  not  show  significant  differences  be- 
tween groups  a  and  b  in  problems  of  type  a  or  of  type  b. 

Comparing  control  and  experimental  groups  in  the  final  testing  (Tables 
16  and  17),  it  was  found  that  there  is  no  significant  difference  in  the 
number  of  correct  solutions  given  by  the  experimental  and  control  subjects 
in  problems  1,  19  and  25  or  in  problems  26  and  41A.   Problem  32F  behaves 
similarly. 

Problems  31DT  and  36F  show  that  experimental  subjects  give  more  correct 
answers  than  controls  for  both  high  school  and  college  freshmen.  Problem 
35B*  shows  the  same  trend  but  only  for  college  students. 

Summarizing,  it  seems  that  the  study  of  the  number  of  correct  solutions 
does  not  show  any  striking  results. 

Many  "byzantine"  arguments  could  be  brought  in  order  to  justify  one  or 
another  type  of  results  and  all  these  arguments  could  be  both  right  or  wrong 
in  terms  of  theoretical  preconceDtions.   What  emerges  clearly  is  that,  as 
far  as  these  findings  show,  changes  in  the  process  (as  indicated  by  number 
of  questions  used)  are  not  related  in  any  clear  manner  to  the  correctness 
of  the  solution.   In  relation  to  this  last  problem,  several  tests  were  per- 
formed, all  of  them  pointing  to  the  fact  that  no  clear-cut  evidence  exists 
to  assume  that  economy  in  questions  asked  is  associated  with  correctness  of 
the  final  solution,  or  vice  versa. 


3)   Study  of  Group  Performance  Ellipsoids 

The  basic  rationale  underlying  this  method  has  been  Dresented  in  seve- 
ral papers  (Rimoldi,  Devane,  Haley,  1959;  Rimoldi,  Devane,  1961).   In 
essence  it  involves  the  following  steps: 

a)  Determine  frequency  with  which  each  question  has  been  asked  by  the 
group  and  find  the  ratio  between  this  number  and  the  total  number  of  sub- 
jects in  the  group.   This  was  defined  as  utility  index.  (Rimoldi,  1955). 

b)  Rank  questions  in  terms  of  their  utility  indexes  and  cumulate 
these  values  for  successive  steps,  thus  obtaining  a  maximum  curve  (when 
cumulating  from  higher  to  lower  utility  indexes),  and  a  minimum  curve  (when 
cumulating  from  lower  to  higher  utility  indexes). 

c)  Between  maximum  and  minimum  curves  an  ellipsoid  is  generated.  The 
area  of  this  ellipsoid  will  vary  with  the  problems  and  the  groups.  If  all 
the  questions  have  the  same  utility  indexes  the  ellipsoids  degenerate  into 
a  straight  line  with  slope  proportional  to  the  constant  utility  index.  In 
the  case  in  which  some  of  the  questions  are  asked  by  all  subjects  (utility 
index  =  1.00)  and  the  remaining  by  no  subject  (utility  index  =  0)  the 
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ellipsoid  becomes  a  parallelogram.   From  this  it  can  be  inferred  that  the 
area  of  the  ellipsoid  is  partially  a  function  of  the  dispersion  of  the 
values  of  the  utility  indexes,  i.e.,  agreement  of  the  subjects  on  the  use- 
fulness of  the  questions  asked. 

d)  The  slope  of  the  maximum  curve  indicates  rate  at  which  subjects 
increase  their  knowledge  or  decrease  their  ignorance.   It  can  be  shown  that 
the  amount  of  information  that  can  be  gained  at  any  step  is  a  constant  frac- 
tion of  the  amount  of  information  yet  to  be  gained.  Experimentally,  it  has 
been  found  for  a  large  variety  of  problems  that  the  function  best  fitting 
the  maximum  curve  is , 


1  max 
and  for  the  minimum  curve. 


:(1  -  e~bx),    b>  0 


bx 


Y  min  =  c(eDX  -  D,     b?   0 

where  y  =  summation  of  utility  indexes  at  x  steps  in  the  sequence,  c  is  the 
y  asymptote  and  b  the  slope.  The  definition  of  b  is: 


y  -  c 


where  y  is  the  first  derivative  of  the  function.  (Rimoldi,  Devane,  Haley, 
1961). 

e)  The  ratio  between  the  area  of  the  ellipsoid  and  the  parallelogram 
may  be  taken  as  an  indication  of  the  amount  of  agreement  among  the  subjects 
concerning  the  utility  of  each  question,  in  relation  to  perfect  agreement. 
(Rimoldi,  Devane,  Haley,  1961). 

In  this  study  a  change  has  been  introduced  in  step  a)  above,  so  that 
instead  of  using  number  of  subjects  in  the  group  as  denominator,  the  total 
number  of  selections  by  the  group  was  employed.  Thus  the  modified  utility 
indexes  are  a  linear  function  of  the  original  ones,  but  the  total  sum  of 
the  modified  utility  indexes  becomes  in  all  cases  1.00.  This  facilitates 
the  comparisons  to  be  made,  since  the  total  number  of  selections  made  by 
the  group  is  controlled.   This  will  give  a  different  view  than  the  one  used 
when  comparing  number  of  questions  used.   The  rest  of  the  procedure  has  not 
been  altered.  The  values  of  "c"  and  "y"  will  be  correspondingly  changed  by 
the  operation  used  to  change  from  number  of  subjects  to  total  number  of 
selections. 

For  every  problem  in  the  ore-test  session,  mid-test  session  and  post- 
test  session,  the  ellipsoids  and  corresponding  parallelograms  were  computed. 
The  corresponding  figures  are  given  in  Appendix  II.   Tables  18  and  19  give 
the  values  of  the  ratios  between  the  ellipsoids  and  the  parallelograms  as 
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well  as  the  significance  of  differences  between  the  maximum  curves  for  dif- 
ferent problems  computed  using  the  Kolmogorov-Smirnov  Test  (Goodman,  1954). 

For  the  pre-testing  session  (problems  1,  19  and  25) ,  there  are  no  sig- 
nificant differences  between  the  control  and  experimental  groups  in  either 
the  high  school  freshmen  or  the  college  frer.hmen. 

At  the  mid-testing  session  the  ellipsoids  for  problems  31C  and  35A' 
are  significantly  greater  in  subjects  of  group  a  than  in  subjects  of  group 
b.   On  the  other  hand,  for  problems  32E  and  36E  no  significant  difference  is 
found.   Remembering  that  the  odd  numbered  problems  are  of  type  a,  and  that 
group  a  was  trained  first  in  problems  of  type  a,  it  is  clear  as  indicated 
by  the  values  shown  in  Tables  18  and  19,  that  training  in  problems  of  type 
a  is  more  effective  than  training  in  problems  of  type  b.   This  training 
carries  over  to  problems  of  the  same  type. 

At  the  end  of  the  experiment  when  all  the  subjects  have  been  equally 
trained  in  problems  of  type  a  and  b,  the  differences  should  disappear,  sinca 
both  groups  a  and  b  have  then  had  equal  training.   This  is  what  happens  as 
it  can  be  observed  in  Tables  18  and  19.  However  there  is  one  exception  and 
this  refers  to  problem  35B',  in  college  freshmen,  which  shows  a  higher  ratio 
in  group  a  than  in  group  b  (ellipsoids  significantly  different  at  .05  level). 

Comparing  the  ellipsoids  for  the  control  and  the  experimental  groups, 
no  differences  were  found  in  the  performance  of  tests  1,  19  and  25,  either 
at  the  college  or  at  the  high  school  level.  This  agrees  with  the  previous 
findings  reported  in  this  study. 

In  problems  31D'  and  35B*  the  experimental  groups  show  a  higher  ratio 
than  the  corresponding  control  groups.   The  values  of  the  ellipsoids  are 
significantly  different  beyond  the  .01  level  (Tables  18  and  19).   The  ellip- 
soids for  problem  32F  are  not  statistically  significant.   In  problem  36F  the 
difference  is  significant  at  the  .01  level  in  favor  of  the  experimental 
group  among  the  college  freshmen. 

Problem  26  shows  no  statistically  significant  differences,  and  problem 
41A  is  significantly  higher  (.05  level)  for  the  experimental  group  among  the 
college  students. 

In  summary,  if  these  ratios  are  interpreted  as  indications  of  agreement 
among  the  group  the  previous  findings  indicate  that: 

a)  Problems  of  type  a  are  more  effective  than  those  of  type  b. 

b)  The  college  group  "improves"  more  under  training  than  the  high 
school  group. 

c)  Training  has  produced  a  change  in  performance  in  all  the  tests  with 
the  exception  of  problems  32F  among  college  freshmen  and  32F  and 
36F  in  high  school  subjects. 
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Table  18 


Ratios  Between  the  Ellipsoids  and  the  Parallelograms  and 
Values  of  the  Kolmogorov-Smirnov  Test  of  Significance  for 
the  Prc-Testingj  Mid-Testing,  and  Final -Testing 
in  High  School  Freshmen 


Ratio 


Kolmogorov-Smirnov 


Problems       L  , lExperi- 

&ontrol'  _JCl«i 

t  mental 


Ratio  !jj 

Group  ajGroup  b J Control /Exper.  Group  a/Group 


I  Pre-  j  19 
Testing  25 


,4535 
.6324 
.4534 


1.71 

1.28 

.27 


31C* 

.8141  ; 

1 
.5202  1 

i 
7 . 94** 

Mid- 

35A' 

.8108 

.7454 

4.82* 

*Te  sting 

32E 

.5982  ; 

.5938 

.34 

36E 

.5026  ' 

.2836 

.11 

1 

.5132 

.6926 

.81 

; 

19 

.7788 

.8269 

.20 

1 

i 

25 

.6105 

.5546 

i 

1.04 

1 
Final 

31 D' 

.5833 

.8904 

.8856  ! 

.9144 

10.92** 

.57 

'Testing 

35B' 

.6306 

.7762 

.7883  ! 

.8108 

7.80** 

.32 

1 

32F 

.4643 

.3596 

.2806 

.5273 

.01 

1.24 

36F 

.4203 

.2945 

.3485  j 

.3036 

I       •» 

.04 

26 

.6084 

.4694 

1 
1 

I 

1    1.31 

41A 

.6239 

.6093 

| 

.73 

1 

.05 

.01 
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Table  19 


Ratios  Between  the  Ellipsoids  and  the  Parallelograms  and 
Values  of  the  Kolmogorov-Smirnov  Test  of  Significance  for 
the  Pre-Testing,  Mid-Testing,  and  Final-Testing 
in  College  Freshmen 


T.atio 

Rat 

io 

X^  Kolmogorov-Smirnov    j 

Problems 

|  Experi-i 
Controls mental  i 

Group  a 

Group  b 

Control/Exper. 

Group  a/Group  b* 

.  „. 
Pre- 

1 

.5661  !  .4643 

.06 

! 

Testing 

19 
25 

.8860  j  .6921 
.6252    .5767 

.64 
3.06 

I 
1 

31C 

! 

.8432 

.5820 

6.27* 

Mid-  i  35A' 

.8072 

.6343 

4.63* 

Testing! 32E 

i 

.6192 

.4863 

.98 

J36E 

i 

.5408 

.5456 

3.25 

! 

1  1 

.4476  j  .6384 

2.14 

j  19 

.8341  '  .8390 

.31 

1  25 

.6919  1  .7115 

j 

.70 

i 

Final  j3lD' 

I 
.6990  I  .9021 

.9151 

.9428 

12.55** 

.26                 \ 

Testing (35B' 

.6381  !  .8419 

.9519 

.77  37 

10.98** 

6.06* 

:32F 

.5070  j  .4649 

'  .5536 

.5208 

.01 

.05 

I36F 

.4225 

.4268 

.5500 

.3842 

10.09** 

1.34 

I26 
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3.08 
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**P<  • 

Dl 
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d)  For  the  entirely  new  problems,  while  problem  26  shows  no  effects  of 
training,  problem  41A  shows  a  change  at  the  college  level. 

Again  it  becomes  more  clear  that  problems  32F  and  26  may  not  be  good 
problems  for  our  purposes,  and  that  college  freshmen,  on  the  whole,  are  more 
susceptible  to  change  than  high  school  freshmen. 


d)  Analysis  of  Individual  Curves  at  the  Group  and  Individual  Levels 

The  scoring  methods  thus  far  described  do  not  take  into  consideration 
the  order  in  which  questions  are  asked.   For  a  given  test  and  a  given  group 
it  is  possible  to  count  the  number  of  times  that  each  question  has  been  asked 
by  the  group  in  each  order.   The  number  of  times  a  question  has  not  been 
asked  can  also  be  easily  determined.   This  we  have  called  0  order.   Each  one 
of  these  frequencies  can  be  expressed  as  a  proportion  of  the  total  number  of 
selections  and  non-selections  made  by  the  group.   This  denominator  is  ob- 
tained by  multiplying  the  number  of  questions  in  the  test  by  the  number  of 
subjects.  The  proportions  in  each  table  by  definition  will  then  necessarily 
add  to  1.00. 

The  performance  of  every  subject  can  be  graphically  represented  by  add- 
ing these  proportions  (observed)  according  to  the  value  of  the  questions  in 
the  observed  order.   The  total  sum  of  these  values  is  a  summary  statement  of 
the  tactics  used  by  the  subject  (Rimoldi,  1961;  Rimoldi,  Devane,  1961; 
Rimoldi,  Haley,  1962&). 

If  the  procedure  just  outlined  is  applied,  then  every  subject  is  scored 
in  terms  of  his  own  group.   Nevertheless,  if  we  aerire  to  obtain  performance 
curves  on  the  basis  of  other  criteria,  then  the  operation  described  will  be 
the  same  but  the  values  corresponding  to  each  question  in  each  order  will 
probably  be  different,  since  they  have  been  obtained  from  the  performance  of 
another  -criterion-  group  or  on  the  basis  of  a  predetermined  condition. 

The  proportions  just  mentioned  can  be  presented  in  the  form  of  a  matrix 
having  the  columns  represent  question  and  the  rows  represent  order.  Each 
matrix  has  then  a  set  of  values  that  will  vary  in  terms  of  the  group  used  for 
their  computation.  Also  matrices  assuming  randomness,  or  any  other  hypo- 
thesis, can  be  built.   In  an  unpublished  study  by  Rimoldi  and  Georgas,  proba- 
bility values  for  the  occurrence  of  a  specific  question  in  a  specific  order 
have  been  calculated. 

The  same  performance  may  be  scored  in  terms  of  the  values  of  each  one 
of  the  matrices,  or  in  terms  of  the  differences  between  corresponding  cells 
of  any  two  matrices.   Thus,  if  we  are  interested  in  comparing  "observed" 
performance  in  terms  of  the  group  to  which  the  subject  belongs,  to  perform- 
ance expected  in  terms  of  another  group,  or  in  terms  of  randomness,  etc., 
the  differences  between  the  corresponding  cells  in  the  two  matrices  under 
consideration  will  be  smaller  the  more  similar  the  values.   If  they  are 
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identical  they  will  be  0  and  the  graphical  representation  of  this  observed 
minus  expected  (0  -  E)  performance  will  give,  by  accumulating  the  successive 
questions  acked,  a  horizontal  line  at  the  0  ordinate.  Whenever  there  is  a 
difference,  a  departure  from  the  0  line  will  appear.   Finally,  the  total 
value  obtained  by  accumulating  all  the  corresponding  (0  -  E)  values  will  give 
a  summary  statement  related  to  the  over-all  departure  of  a  tactic  scored  in 
terms  of  the  difference  between  observed  and  expected  values. 

This  means  then  that  for  every  subject: 

a)  Observed  performance  curves  can  be  obtained. 

b)  Expected  performance  curves  can  be  obtained. 

c)  The  difference  (0  -  E)  curve  can  be  obtained. 

d)  A  summary  statement  for  the  observed  tactics  can  be  obtained. 

e)  A  summary  statement  about  (0  -  E)  tactics  can  also  be  obtained. 

This  can  be  done  also  for  questions  not  asked,  that  is  in  0  order.   But 
since  here  we  have  no  way  of  estimating  in  which  order  the  questions  not 
asked  would  have  been  asked  if  this  were  possible,  then  no  curves  can  be 
drawn,  though  the  accumulation  of  the  values  of  the  questions  not  asked  is 
possible.   This  holds  both  for  the  observed  and  expected  and  (0  -  E)  values. 
That  is,  every  performance  can  be  expressed  as  a)  what  the  subject  does,  and 
b)  what  the  subject  does  not  do. 

The  previous  type  of  evaluations  are  essentially  based  on  averages. 
But  approaches  of  this  kind  eliminate,  by  their  very  definition,  individual 
differences,  or  at  least  make  it  difficult  to  observe  them  without  the  bias 
introduced  by  the  use  of  averages.  One  of  our  aims  has  been  to  define  norms 
that  would  not  depend  on  average  group  performance,  but  rather  on  the  proper- 
ties of  the  problems  administered  to  the  subjects. 

In  trying  to  understand  the  specifications  needed  to  use  a  scoring 
approach  not  based  on  averages,  the  concepts  of  "schemata"  and  "content" 
were  derived  (Rimoldi,  Haley,  Fogliatto,  Erdmann,  1962,  unpublished).   Sche- 
mata are  represented  by  the  formal  properties  or  set  of  relationships  em- 
bodied in  the  problem,  and  content  are  the  objects  used  to  realize  the  prob- 
lems, i.e.,  objects,  numbers,  etc. 

Most  of  the  problems  used  in  this  research  were  prepared  by  inventing 
first  the  appropriate  schemata  and  then  introducing,  for  the  same  schema, 
different  contents.  The  schemata  were  then  varied  in  difficulty  by  the 
experimenter.  This  usually  represented  the  introduction  of  a  larger  number 
of  relationships  of  the  same  type  or  new  type  of  relationships  not  yet  dealt 
with  in  previous  schemata.   (In  Appendix  I  and  Figures  1  to  6  inclusive,  the 
schemata  are  given) . 
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Several  scoring  methods  may  be  developed, 
sented. 


Two  of  them  will  be  pre- 


The  study  of  the  schemata  makes  it  possible  to  establish  the  scoring 
norms  for  each  problem  in  terms  of  the  sequence  of  logical  relationships 
involved.  This  is  a  relatively  easy  matter  once  the  structure  of  the 
problem  is  known.   For  instance }   for  the  schema  presented  in  Figure  1,  prob- 
lem 31A,  the  rationale  for  the  scoring  norms  is  presented  in  Figure  7. 
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Figure  7 


1st    2nd    3rd 
Order  Order  Order 


Question  6  should  be  first  in  all  the  tactics.   It  may  be  followed  by 
3  and  10  or  by  5  and  9.   Both  3  and  10  can  be  interchanged  so  that  each  one 
of  them  may  be  asked  in  2nd  or  3rd  order^  and  similarly  5  and  9.   The  four 
possible  tactics  are  presented  in  Table  20. 


Table  20  * 
Four  Possible  Tactics  for  Problem  3IA 


Questions 


Tactics  1 

1 

~> 

1    3 

4 

5    , 

6 

;  7 

8 

9 

10 

a 

. 

1 

1 

3     ! 

b 

!    3 

1 

| 

2       i 

c 

1 

2    1 

1 

3 

d 

i 
! 

3 

1 

2 

| 

*   (The  entries  represent  order  of  choice.) 
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When  scoring  the  performance  of  a  given  subject,  a  value  of  1.00  or  0 
may  be  assigned  to  each  successive  choice  according  to  its  agreement  with 
the  norms.   For  instance,  if  we  use  tactic  a  and  a  subject  selects  ques- 
tions 6 ,  3,  10  in  this  order  then  he  will  obtain  a  score  of  1.00  for  each 
question  since  he  agrees  perfectly  with  the  theoretically  developed  tactic. 

If  the  subject  selected  questions  6,  10,  3,  and  we  score  in  terms  of 
tactic  a,  (Table  20),  then  he  will  only  obtain  a  score  of  1.00  for  question 
6,  but  0  for  questions  10  and  3,  though,  if  he  were  scored  in  terms  of 
tactic  b,  his  score  would  be  3.   In  order  to  be  fair,  every  subject  should 
then  be  scored  in  terms  of  all  the  theoretically  developed  tactics.  This 
will  increase  the  amount  of  work  unnecessarily.   It  was  thus  decided  to 
pool  together  all  the  theoretically  developed  tactics  and  assign  a  weight 
to  each  question  in  each  order  according  to  its  frequency  of  occurrence  in 
that  order.   Thus,  for  problem  31A,  a  set  of  weights  could  be  that  given  in 
Table  1,  Appendix  III,  where  the  0  order  is  included  and  the  sum  of  all  the 
entries  in  the  table  is  arbitrarily  made  equal  to  1.00,  in  order  to  have  the 
same  total  in  all  the  tables  corresponding  to  all  the  problems.   The  pos- 
sible tactics  are:   6,  3,  10;   6,  10,  3;   6,  5,  9;   and  6,  9,  5.   Questions 
not  in  the  tactics  are  1,  2,  4,  7  and  8.   For  instance,  question  6  appears 
in  all  the  tactics  in  first  position  which  makes  a  total  of  4,  that  aver- 
aged in  terms  of  tactics  gives  a  value  of  1.00.   Since  there  are  10  cards, 
the  value  finally  given  to  6  will  be  .10.   Question  10  may  appear  in  order 
2  or  3,  in  all  the  possible  tactics  as  defined.   Thus,  adding  the  corre- 
sponding value  and  dividing  by  the  total  number  of  tactics  multiplied  by 
the  total  number  of  cards  in  the  problem,  we  obtain  a  value  of  .05  as 
shown  in  the  Z  row  of  Table  1,  Appendix  III.   But,  since  it  can  be  located 
in  orders  2  or  3  the  corresponding  value  for  this  card  in  these  orders  will 
be  respectively  .025  and  .025.   Since  having  10  cards  and,  under  the 
assumption  of  equal  probability  of  each  card  being  chosen,  the  S  column 
should  be,  for  all  the  cards  .10.  Then  the  2  ,  that  is,  the  value  for  the 
zero  position,  will  be  .05. 

In  order  to  score  the  performance  of  a  subject  and  obtain  his  perfor- 
mance curve,  several  approaches  may  be  followed.   Some  of  these  will  be 
discussed. 

A)  Add  the  values  given  in  the  corresponding  table  for  successive 
choices.  Thus,  for  the  tactic  9,  6,  10,  5,  we  obtain,  from  Table  1, 
Appendix  III;   0  +  .  0  +  .025  +  0  =  .025.   The  performance  curve  will  then 
show  a  plateau  at  0  for  the  first  two  questions  rising  to  .025  in  the 
third  question  and  adding  nothing  for  the  fourth  question. 

Tactic  6,  3,  10,  in  terms  of  Table  1,  Appendix  III,  will  be:   .100  + 
.025  +  .025  =  .150.  This  method  is  conservative  in  the  sense  that  if  a 
subject  has  chosen  the  question  according  to  the  prescribed  tactics  in  the 
order  defined,  but  other  irrelevant  questions  have  also  been  asked,  then 
this  may  reduce  his  score  to  0.   For  instance,  a  subject  choosing  1,  6,  4, 
3,  10,  since  6  does  not  occur  in  2nd  order  and  3  does  not  occur  in  4th 
order  and  10  does  not  occur  in  5th  order,  will  obtain  a  total  score  of  0. 


45  - 


Nevertheless,  it  may  be  said  that  the  subject  did  not  realize  the  problem 
right  away  and  that  after  asking  question  I,  reorganized  his  thoughts  and 
realized  that  question  6  should  have  been  asked  first.  The  same  reasoning 
can  be  used  for  the  other  irrelevant  questions. 


B)  From  the  observed  sequence,  pull  out  the  irrelevant  questions 
keeping  the  relevant  ones  in  their  original  position,  but  renaming  them 
following  the  sequence  of  natural  numbers,  1,  2,  3,. 

For  instance,  the  sequence  1,  6,  3,  8,  2,  10,  (sec  Figure  7)  becomes 
6,  3,  10,  where  6  is  first,  3  second,  and  10  third,  that  is:   .100  +  .025  + 
.025  =  .150. 

If,  after  pulling  out  the  irrelevant  questions,  the  sequence  that  re- 
mains only  represents  partially  any  of  the  predefined  tactics,  proceed  by 
considering  only  those  items  that  follow  the  sequence  of  the  predefined 
tactic. 

For  instance,  the  sequence  1,  3,  6,  2,  8,  10,  becomes  3,  6,  10.  A 
person  asking  for  question  3,  in  terms  of  the  norms  indicates  worse  planning 
of  his  thinking  performance  and  this  should  be  considered  in  his  scoring. 
Nevertheless,  the  fact  that  his  next  question  was  6  followed  by  10,  indicates 
that  some  reshaping  has  taken  place.   There  is,  of  course,  the  possibility 
that  this  is  purely  accidental  but  it  would  be  almost  impossible  to  know  it. 
The  subject's  score  will  then  depend  only  on  questions  6  and  10,  that  is: 
.100  +  .025  =  .125. 

The  sequence  1,  3,  10,  2,  8,  6,  becomes  3,  10,  6.  For  the  same  reason 
stated  above,  only  6  could  be  given  credit,  that  is,  .10. 

Now,  if  the  sequence  involves  several  of  the  predefined  tactics,  in  part 
or  in  whole,  then  after  eliminating  the  irrelevant  questions,  give  credit  to 
those  questions  that  will  give  the  maximum  score.   This,  of  course,  gives  the 
benefit  of  the  doubt  to  the  subjects.   For  instance  the  sequence  1,  6,  5, 
10,  2,  3,  after  eliminating  the  irrelevant  questions,  becomes  6,  5,  10,  3, 
froD  where  sequences  6,  5  and  6,  10,  3  can  be  obtained.  Give  credit  for 
sequence  6,  10,  3,  if  this  will  give  a  higher  score  than  6,  5.   For  instance, 
sequence  6,  10,  3  gives  .100  +  .025  +  .025  =  .150,  while  sequence  6,  5 
gives  .100  +  .025  =  .125. 

After  adding  the  weights  for  the  sequence,  divide  the  total  amount  by 
the  total  number  of  questions  asked.   This  implies  that  any  irrelevant 
question  is  similar  to  any  other  irrelevant  question.   This  implies  also 
that  not  only  questions  defined  as  irrelevant  in  terms  of  the  predefined 
tactics,  but  also  questions  that  are  relevant  but  asked  in  the  wrong  order, 
are  given  a  score  of  0.   This  system  of  scoring  seems  to  fulfill  the  notion 
that  both  question  and  order  are  important  as  well  as  planning  the  attack 
to  the  problem. 
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Notice  that  using  the  "pulling  out"  method,  the  sequence  9,  6,  10,  5, 
given  in  A)  above  becomes  6,  10  or  6,  5,  that  is,  in  both  cases  .100  +  .025 
=  .125. 

Dividing  the  value  of  the  sequences  given  above  by  the  total  number  of 
questions  used,  we  obtain: 

Sequence   1,   6,   3,   8,   2,  10   =    £  l?°  =  .025 

6 

Sequence   1,   3,   6,   2,   8,  10    =   ■  '    .    =  .021 

6 

Sequence  1,   3,  10,   2,   8,   6   =    •l0°    =  .017 
Sequence   1,   6,   5,  10,   2,   3        'l^5  =   .021 

Sequence   9,   6,  10,   5  =    : 125    =  .031 

One  of  the  maximum  tactics  will  be  6,  5,  10,  that  is   " . 5Q   =  .50, 

but  6,  2,  5,  10,  will  be   :      =  .375.   That  is,  question  2  has  reduced 

4 

the  final  value  from  .50  to  .375. 

The  performance  curves  that  represent  the  subject's  approach  to  the 
problem  are  built  by  accumulating  the  values  of  all  the  questions  asked  in 
the  eoi.-«.espondi.r£  order,  as  indicated  in  A).   (Tables  in  Appendix  III). 

Thus,  a  given  tactic  will  have  a  unique  performance  curve  but  the 
numerical  representation  will  depend  on  whether  methods  A),  or  B)  above  are 
used. 

Though  method  B)  has  been  explored  in  some  cases,  the  bulk  of  our  data 
was  studied  using  method  A). 
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For  each  subject  in  each  test  his  performance  curve  was  drawn  and  the 
score  was  computed  as  indicated  in  the  previous  sentence.  * 

Performance  curves  were  drawn  for  each  experimental  subject  in  problem 
31A,  31B,  31C,  31D,  33A,  33B,  33C,  33D,  35A,  35B,  35C,  35D,  32A,  32B,  32C, 
32D,  34A,  34B,  34C,  34D,  36A,  36B,  36C,  36D  and  in  the  college  experimental, 
37A,  37B,  38A,  and  38B. 

The  tables  as  obtained  from  the  schemata  for  each  one  of  thes^  problems 
are  given  in  Appendix  III.  Also,  for  each  subject,  whether  control  or  ex- 
perimental, performance  curves  were  built  for  problems  26  and  41A.   These 
performance  curves  were  obtained  by  a)  observed  group  performance  (0  curves) 
and  b)  score  following  the  schemata.   These  two  curves  for  each  single  sub- 
ject in  each  problem  were  plotted  together  on  the  same  graph. 

It  would  be  impossible  to  describe  every  one  of  the  curves  plotted  using 
both  methods,  and  thus  we  will  limit  our  analysis  to  a  few  of  them.   These 


*  Assume  that  in  a  problem,  in  terms  of  the  schemata,  the  following  se- 
quences are  found,  6,  3,  9,  and  5,  4,  2,  where  in  the  first  tactic  3  and  i 
may  be  interchanged.   The  table  of  tactics  will  then  look  as  follows. 


Questions 


'  Tactics   : 

1 

2 

3 

4 

5 

6 

7 

1    8 

!    9 

10 

1                      1 
3            1 

3 

1 

1 

1 

1    2 

b            1 

2 

1 

|    3 

c 

| 

> 

3 

2 

> 

1 

: 

1 

The  entries  in  this  table  represent  order  of  choice 

Considering  that  both,  6,  3,  9,  and  5,  4,  2,  are  equally  good,  then 
using  the  method  described,  a  subject  using  tactic  5,  4,  2  will  be  punished 
in  his  final  score,  which  will  be  lower  than  the  one  corresponding  to  6,  3, 
9.   In  order  to  avoid  this,  a  system  of  weighting  was  derived,  such  that, 
for  instance,  question  6  and  question  5,  in  first  order  would  have  the  same 
value.   Similarly,  for  the  other  questions.   Most  of  our  subjects  were  re- 
scored  using  this  approach,  but  the  differences,  when  compared  with  the 
scoring  method  described  in  the  body  of  the  text,  were  minimal,  and  thus 
unless  it  is  explicitly  stated  so,  the  results  presented  in  this  study  are 
not  obtained  by  using  the  weighted  approach.   For  some  problems  it  might 
conceivably  be  advantageous  to  use  the  weighted  approach. 
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curves  are  given  in  Figure  8,  and  their  study  will  help  to  understand  more 
clearly  the  properties  of  both  scoring  systems. 

In  Figure  8,  the  performance  of  a  subject  in  problem  31A  (See  Appendix  I) 
is  given.   The  tactic  was  9,  6,  10,  5.   The  solid  line  performance  curve  is 
the  one  obtained  using  the  observed  (group)  values  and  the  broken  line  curve 
is  obtained  using  schema  values.   The  subject  solved  the  oroblem.   In  terms 
of  the  schema  he  is  on  the  zero  line  for  the  first  two  selections.   The 
broken  line  curve  shows  two  plateaux,  one  corresponding  to  the  first  few 
questions  asked  and  the  other  one  corresponding  to  the  last  question  asked. 
Nevertheless,  the  observed  performance  curve  shows  a  continuous  increase , 
though  differently  accelerated  in  different  parts  of  the  curve.  Judging  by 
this  curve,  we  would  be  tempted  to  conclude  that  at  all  steus  during  the 
process  the  subject  was  accumulating  "knowledge",  but  when  his  performance 
is  analyzed^  considering  the  sequence  as  obtained  from  the  schema  of  the 
oroblem,  it  is  found  that  his  planning  was  rather  poor.   That  is,  in  order 
to  solve  the  problem,  &a   he  did,  he  probably  hp.d  to  throw  the  information  he 
obtained  from  the  questions  he  asked,  back  and  forth  to  complete  it. 

Next,  let  us  take  the  curves  that  correspond  to  the  same  subject  in 
nroblem  31B,  which  has  the  same  schema  as  problem  31A,  but  an  aSstract 
content  (see  Appendix  I).   Here,  the  sequence  used  was  8,  9,  5,  3,  1,  2,  4, 
7.   According  to  the  schema,  the  sequence  should  be  1,  7,  2,  9  or  1,  7,  4, 
3.   The  subject  did  not  solve  the  problem.   If  attention  is  paid  to  the 
observed  curve  (group  norms)  one  would  be  tempted  to  conclude  that  Lis  per- 
formance showed  a  progressive  improvement.   Nevertheless,  the  broken  line 
shows  a  completely  different  picture;   it  now  raises  from  the  zero  line. 
The  subject  seems  to  have  never  done  any  clear-cut  planning  ff  his  procedure. 
As  a  matter  of  fact,  he  asked  questions  of  both  sequences,  1,  7,  2,  9  and  1, 
7,  4,  8,  without  any  clear  idea  of  what  and  when  to  ask. 

This  is  still  more  dramatic  for  the  same  subject  in  problem  31D.  This 
Droblem  (see  Appendix  I)  reaches  the  highest  degree  of  abstraction  within 
the  Fame  schema.   The  subject  did  not  solve  it.   His  sequence  was  2,  4,  6, 
7.   In  terms  of  the  schema  he  should  have  used  sequence  6,  2,  4,  7  or  6,  2, 
3,  8.   The  observed  nerformance  is  very  impressive,  while  the  performance 
in  terms  of  the  schema  is  very  ooor.   Again,  though  the  subject  asked  all 
the  questions  required,  he  showed   little  planning  in  his  sequence.   His 
plateau  is  on  the  zero  line  for  the  first  three  selections. 

The  remaining  curves  show  the  performance  of  another  subject  in  Prob- 
lem 33C  *,  based  on  the  performance  of  a  subject  wh*»  used  the  sequence  2, 
9,  10,  6.   The  sequences  derived  from  the  schema  can  be:   2,  9,  10,  6  or 
2,  9,  12,  11,  6.   Notice  that,  in  terms  of  the  observed  group  values,  the 


*   The  tables  for  observed  values  are  not  presented  in  this  report.   They 
are  available  upon  request  to  the  authors. 
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curve  is  "worse"  than  the  one  obtained  using  the  schema  values.   The  subject 
solved  the  problem. 

These  examples  show  that  evaluating  a  subject's  performance  in  terms 
of  a  group  is  very  different  from  evaluating  a  subject  in  terms  of  the  logi- 
cal approach  to  the  problem.  The  first  type  of  evaluation  is  based  on  what 
has  been  defined  here  as  extrinsic  difficulty.   It  probably  depends  on  a 
large  number  of  variables  and  to  a  certain  extent  it  is  the  product  of 
confusion  in  the  sense  that  if  one  or  several  subjects  choose  a  question, 
just  for  choosing  it,  this  will  show  as  a  positive  value  in  spite  of  the 
fact  that  logically  the  question  may  be  meaningless.   That  is,  group  norms 
are  highly  misleading  and  do  give  a  distorted  picture  of  the  subject's  pro- 
cess. The  implication  of  this  extends  to  test  theory  in  general.   If  we  are 
interested  in  appraising  high  talent,  and  possibly  creativity,  conformity 
with  the  group  is  probably  one  of  the  worse  procedures  to  follow.  After  all,y 
logic  and  common  sense  may  not  be  equivalent. 

The  plateaux  may  be  considered  as  an  indication  of  "disturbances"  in 
the  thinking  processes.  By  disturbance  we  do  not  mean  a  pathological 
approach,  but  rather  taking  devious  paths,  detours,  or  asking  questions 
that  are  irrelevant.   This  is  what  is  implied  in  our  system  of  scoring. 
Therefore,  the  analysis  of  the  plateaux  may  provide  information  as  to  the 
over-all  planning  used  by  the  subjects.   Of  course,  any  interpretation 
should  be  based  on  the  schemata  as  defined. 

By  inspection  of  the  performance  curve  of  each  subject,  it  is  possible 
to  measure  the  plateaux  in  his  curve.  These  plateaux  may  extend  to  any 
value  between  1  and  the  total  number  of  questions  asked.   For  instance,  if 
a  subject  asks  questions,  of  which  none  has  a  value  higher  than  zero,  then 
his  whole  curve  will  be  a  plateau  as  long  as  the  number  of  questions  asked. 
The  length  of  all  the  plateaux  for  each  subject  in  each  problem  can  be  com- 
puted, and  their  averages  calculated. 

In  Table  21,  the  mean  length  of  the  plateaux  for  problems  26  and  41A, 
are  presented. 

Notice  that  the  average  length  of  the  plateaux  is  shorter  in  the 
college  freshmen  than  in  the  high  school  freshmen.   Further,  the  comparison 
of  the  means  between  control  and  experimental,  shows  that  the  latter  have 
shorter  plateaux  than  the  controls.  This  is  a  general  trend  and  holds  for 
both  the  college  and  high  school  freshmen.   The  t  values  (Table  21,  one 
tailed  test),  strongly  suggest  that  the  experimental  group  proceeds  more 
directly  and  asks  fewer  irrelevant  questions  than  the  control  group.   By 
inference,   they  plan  a  better  attack  on  the  problem.   Again,  the  college 
freshmen  do  this  better  than  the  high  school  freshmen.   The  t  values  given 
at  the  bottom  row  of  Table  21  show  that  the  differences  between  college  and 
high  school  freshmen  in  the  experimental  group  are  significant  at  least  at 
the  .05  level  (two  tails)  for  both  problems  26  and  41A.   For  the  control 
group,  this  difference  is  only  significant  for  problem  26.  Again,  college 
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students  seemed  to  change  more  than  high  school  freshmen ,  and  problem  26 
differentiates  better  than  problem  41A. 


Table  21 

Mean  Length  of  Plateaux  for  Problems  26  and  41A  in  the 
Final  Testing  for  High  School  and  College  Freshmen 


Problem  26 

Problem  41A 

|  _   .   n  |_      !"t"  value 
I  Control . Exoer.  L       .,. 
l(one  tail) 

Control  Exper. 

"t"  value 
(one  tail) 

Sigh  School    6.136   5.00     1.701 

!  4.409  ;3.727 
i        j   

1.541 

College     i   4.188  12.938  j  2.10* 

|  3.312  12.312 

!         ! 

1.391 

k«  value   j  2<09  ^|2>17  J 
i( two  tails)  1        I 

1         ! 

;  1.30   ;2.33  * 

p  <.  .05 
p<.10 


The  length  of  the  plateaux  was  measured  for  Tests  31  (A,  3,  C,  D) , 
33  (A^  By  C,  D)  and  35  (A,  B,  C,  D)  in  each  subject  during  the  training 
sessions. 

An  analysis  of  variance  was  performed  separately  for  the  high  school 
and  for  the  college  freshmen.* 

The  results  were  similar  in  both  cases,  showing  that  the  schemata 
corresponding  to  tests  31,  33,  and  35,  and  the  content  corresponding  to 
forms  k3   B,  C,  D,  contributed  significantly  (over  the  .01  level)  to  the 
total  variance.  A  significant  F  ratio  (.01  level)  was  also  obtained  for 
the  interaction  schemata-content,  in  the  college  freshmen,  and  for  the 
interaction  individuals-schemata,  in  the  high  school  freshmen. 

That  is,  schemata  and  content  are  both  significant  sources  of  variation 
This  helps  to  verify  some  of  the  assumptions  used  in  building  the  tests, 
such  that  schemata  could  be  made  progressively  more  complex  and  content 
could  be  made  progressively  more  unfamiliar. 

The  mean  length  of  the  plateaux  for  high  school  and  college  freshmen 
is  presented  in  Tables  22  and  23.  A  graphic  representation  of  these  tables 
is  given  in  Figures  9  and  10. 


These  analyses  of  variance  are  available  upon  request  to  ths  authort 
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Figure  9.   Mean  Length  of  Plateaus  of  High  School  and  College  Subjects  on 
Problems  31,33,  and  35. 
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Figure  10.   Mean  Length  of  Plateaus  of  High  School  and  College  Subjects  on 
the  Four  Forms  of  the  Tests. 
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Table   22 
Mean  Length  of  Plateaux  for  Schemata   51,    33,    35 


Schemata 
31  33        ,  35 


High  School  I 

Jl      u  3.250  4.396      |     2.104 

Freshmen 


College 
Freshmen       i 


1 

2.469  3.438      !     1.312 


Table  23 


Content 

;     a 

B       \-> 

'lV—.\ 

! 

'   2.389 
J 

4.083  j  3.000 

1 

J 
3.528  I 

i 

1.500 

j 
2.958  i  2.542 

1       1 
|  2.625  j 

High  School 
Freshmen 

College 

Freshmen 


From  these  results  several  trends  emerge  clearly.   Both  in  terms  of 
schemata  and  content,  high  school  students  show  lengthier  plateaux  than 
college  students.  Besides,  both  Figures  9  and  10  show  that  the  curves  are 
almost  parallel,  with  an  apparent  exception  corresponding  to  content  of 
form  C.   Nevertheless,  in  terms  of  the  content,  both  groups  show  that  the 
trend  in  terms  of  length  of  plateaux  is  L,   C,  D  and  B.   In  terms  of  schemata, 
the  trend  is  35,  31  and  33. 

Considering,  as  indicated  in  Table  1,  that  the  order  of  the  problems 
was  31A,  31B,  31C,  31D,  33A,  33B,  33C,  33D,  35A,  35B,  35C,  35D,  the  graphs  of 
Figures  9  and  10  acquire  an  interesting  meaning.  Training  in  progressively 
more  complicated  logical  relationships  as  indicated  by  the  schemata  (Figures 
2  to  4  inclusive)  shows,  after  an  increase  in  length  of  the  plateaux  (schema 
33),  a  clear  drop  for  schema  35.   It  is  appropriate  to  remember  that  training 
in  each  schema  was  based  on  contents  A,  B,  C  and  D.   Further,  content  of  form 
A  produces  plateaux  of  shorter  lengths  than  any  other  content,  the  longest 
corresponding  to  content  of  form  B. 
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Because  of  the  order  of  administration  of  the  problems ,  these  findings 
ought  to  be  appropriately  weighted  since,  before  beginning  problems  with 
schema  33,  the  subjects  have  been  trained  with  four  problems  with  schema  31, 
and  before  starting  with  problems  with  schema  35 ,  the  total  number  of 
previous  training  problems  had  been  eight.  There  is  not  the  same  monotonic 
relationship  between  content  and  number  of  previous  training  problems.   For 
instance,  content  B  was  present  in  the  2nd,  6th  and  10th  training  problem. 
This  makes  the  interpretation  of  Figure  10  less  clear  than  the  interpretation 
of  Figure  9. 

In  Tables  24  and  25,  the  mean  length  of  the  plateaux  for  each  problem 
is  presented. 


Table  24 
Mean  Length  of  Plateaux  (High  School  Freshmen) 


(Schemata 

Content 

1 

A 

1          B 

;       C 

D 

1        31 

1.25 

4.67 

i 

3.08 

|     4. CO 

33 

4.00 

1     4.92 

i     4.33 

J     4.33 

i 

1        3S 

1.92 

2.67 

|     1.58 

j     2.25 

Table  25 
Mean  Length  of  Plateaux  (College  Freshmen) 


.Schemata  | 

Content 

! 
| 

31       i 

A 

B 

1                     \J 

D 

1.00 

3.88 

1 

2.12 

1 

2.88 

53    1 

2.00 

4.00 

3.75 

4.00 

55       ! 

1.50 

1.00 

1.75 

1.00 

1 
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Figures  11  and  12  represent  the  values  given  in  Tables  24  and  25, 
respectively. 

Comparing  Figures  11  and  12,  it  emerges  clearly  that  the  curves  for  the 
same  schema  followed  the  same  trend  in  high  school  and  college  freshmen. 
Schema  31 ,  which  was  present  in  the  first  four  problems  administered,  shows 
the  intervariation  for  different  contents.   Schema  35  is  the  one  showing  \esz 
variation  and  so  is  schema  33  in  high  school  students.   In  college  students, 
there  is  a  drastic  change  only  between  forms  A  and  B. 

Inspection  of  these  graphs  points  to  the  fact  that,  while  there  is  for 
schema  31  and  33  a  clear  interaction  with  content,  in  schema  35  the  famili- 
arity of  the  content  is  less  important  in  determining  the  length  of  the 
plateaux.  As  is  were,  training  produces  a  homogeneity  in  performance,  re- 
ducing the  effects  of  content  familiarity. 

In  order  to  clarify  the  interesting  points  that  this  suggests,  further 
work  is  being  performed.   It  will  not  be  reported  here  because  of  insuffi- 
cient time  to  complete  it. 

Nevertheless,  if  a  certain  amount  of  cautious  interpretation  is  allowed, 
changing  content  from  very  concrete  (A)  to  abstract  (B)  produces  a  noticeable 
change  in  performance.   In  general,  familiarity  with  the  content  seems  to  be 
inversely  related  to  length  of  plateaux,  up  to  a  critical  training  period. 
Plateaux,  as  explained  before,  may  indicate  "defective"  planning.  Again,  the 
results  seem  to  suggest  that  increasing  the  complexity  of  the  schemata  (31, 
33,  35)  tends  to  lengthen  the  plateaux  up  to  a  point  in  which  training,  as 
it  were,  becomes  effective  and  overshadows  the  effects  of  this  complexity. 
Of  course  we  do  not  know  what  type  of  exact  relationship  holds  between  these 
variables.   The  possibility  of  verifying  these  points  would  require  a  design 
slightly  different  from  the  one  used  in  this  study.  A  further  point  to  be 
mentioned  is  that  the  type  of  analysis  that  preceeds  was  not  used  for  prob- 
lems 32  to  36  inclusive  or  for  group  b  who  took  problems  of  type  b  first. 

Large  numbers  of  individual  performance  curves  have  been  drawn  for  each 
sugject  in  all  the  problems  administered  during  the  training  session  using 
the  scores  based  on  group  norms  and  schemata.  The  study  of  the  plateaux  as 
training  proceeds  as  well  as  other  characteristics  of  the  curves  is  now  in 
progress.   Changes  in  the  curves  have  been  observed  as  training  proceeds. 
The  meaning  of  these  changes  is  not  yet  totally  clear.  No  further  evaluation 
of  the  performance  curves  will  be  made,  other  than  the  study  already  reported. 

e)   Convex  Sets 

The  rationale  behind  this  method  for  the  study  of  processes  has  already 
been  published  (Rimoldi,  1961;   Rimoldi,  Devane, 1961;   Rimoldi,  Haley  ,  1962a} 
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Tactics  have  been  defined  in  terms  of  the  sequence  followed  in  solving 
a  problem.   Thus,  for  every  problem,  there  is  a  limited  number  of  tactics. 
Since  the  value  of  each  question  asked  depends  on  its  position  in  the  se- 
quence, then  the  accumulation  of  these  values  will  give  a  summery  description 
of  the  tactic.   These  values  can  be  readily  obtained  from  the  end  point  of 
the  performance  curve.   For  questions  not  asked,  the  same  approach  can  be 
followed. 

If  each  question  is  evaluated  in  terms  of  the  observed  value  minus  the 
expected  value,  as  indicated  in  section  d).  of  this  chapter,  then  each  tactic 
ean  also  be  expressed  in  terms  of  its  over-all  cumulative  departure  from  the 
observed  values,  (0  -  E) . 

In  this  study,  performance  curves  were  drawn  for  observed  values,  using 

both  the  group  and  the  schemata  norms,  and  (0  -  E)  performance  curves  were 

drawn  using  as  expected  values,  proportions  obtained  under  the  assumption  of 
randomness  (Rimoldi,  Georgas,  unpublished). 

The  same  cases  that  were  described  in  Figure  8  are  shown  now  in  Figure 
13.   The  solid  lines  represent  (0  -  E)  when  the  group  performance  is  used  for 
the  observed  values  and  the  broken  lines  correspond  to  the  evaluation  based 
on  the  schemata. 

The  first  set  of  curves  (a)  correspond  to  problem  31A  that  was  solved 
by  the  subject.  Problem  31B  was  not  solved  (curves  b).  In  this  case,  using 
group  performance,  the  (0  -  E)  curve  departs  somewhat  from  randomness  while 
by  using  the  schemata,  the  (0  -  E)  curve  shows  a  progressive  decrement,  thus 
departing  from  randomness  more  than  the  group  performance  curve.   For  problem 
31D,  (curves  c),  which  also  was  not  solved  by  the  subject,  the  (0  -  E)  curve 
departs  very  markedly  from  randomness  when  using  group  norms,  while  when 
using  schemata,  it  remains  near  zero.   In  problem  33G  (curves  d) ,  which  was 
solved  by  the  subject,  both  (0  -  E)  curves  depart  from  randomness. 

A  further  distinction  can  be  made  in  terms  of  the  direction  of  the 
departure  of  the  (0  -  E)  curves  from  the  zero  line.  A  positive  departure  may 
indicate  that  though  the  subject  departs  from  randomness,  the  direction  of 
the  departure  tends  to  be  in  agreement  with  the  0  norms.  A  negative  de- 
parture, though  also  indicating  separation  from  randomness,  suggests  that 
the  subject  is  also  acting  contrary  to  the  norms. 

In  general,  it  could  be  expected  that  the  (0  -  E)  curves,  when  0  is 
based  on  group  performance,  will  show  a  positive  deviation,  since  the  sub- 
jects are  members  of  the  group.  A  negative  departure  may  indicate  that  the 
subject  disagrees  with  the  group.   This  does  not  necessarily  mean  "bad"  per- 
formance, but  rather  a  unique  one  in  terms  of  the  group. 

In  all  the  curves  for  all  the  subjects  used  in  this  study,  the  tendency 
of  the  (0  -  E)  curves  is  in  the  positive  direction,  when  using  group  norms. 
Returning  to  Figure  13,  notice  that  for  curves  a,  b  and  c,  the  trend  des- 
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cribed  is  followed,  while  for  curves  d,  when  using  schemata  norms,  the 
(0  -  E)  performance  deviates  positively  from  the  zero  line. 

Plotting,  for  each  tactic,  the  cumulative  values  of  the  0  curves  on  the 
abscissa  and  the  corresponding  (0  -  E)  values  on  the  ordinate,  convex  sets 
are  obtained.  These  sets  have  been  developed  for  problems  31A,  31B,  31C, 
31D,  33A,  33B,  33G,  33D,  35A,  35B,  35C,  35D,  for  college  and  high  school 
freshmen,  as  well  as  for  problems  37A  and  37B  in  college  freshmen.   The  norms 
used  for  these  convex  sets  were  based  on  group  performance.   Convex  sets  for 
problems  26  and  41A  were  drawn  for  both  student  groups,  using  group  and 
schemata  norms. 

The  studv  of  the  convex  Bets  corresponding  to  the  training  problems 
shows  that  college  students  tend  to  have  higher  SO  values  and  less  dispersion 
around  the  S(0  -  E)  values.  That  is,  they  are  more  consistent  than  high 
school  freshmen.   This  adds  further  strength  to  the  findings  obtained  with 
the  other  scoring  methods. 

A  more  detailed  analysis  was  performed  for  problems  41A  and  26,  which 
were  given  at  the  post-testing  session. 

In  Figures  14  to  21  inclusive  we  present  the  convex  sets  corresponding 
to  problems  26  and  41A  in  both  college  and  high  school  students  using  both 
group  norms  and  schemata  norms.  All  of  these  figures  have  been  drawn  to  the 
same  scale.   The  numbers  in  the  figures  correspond  to  the  tactics  followed. 
The  sequence  corresponding  to  each  tactic  is  given  at  the  bottom  of  each 
figure.   Only  tactics  in  the  corners  of  the  sets  are  numbered. 

The  discussion  that  follows  is  not  all  that  can  be  done  with  these  re- 
sults.  For  the  purposes  of  this  report,  we  only  want  to  call  attention  to 
some  findings  that  are  of  interest.   More  work  on  this  problem  is  now  being 
actively  performed. 

When  we  compare   the  college  and  high  school  freshmen,  using  &roup  norms, 
in  problem  26  (Figures  14  and  16),  we  find  that  there  is  not  a  great  differ- 
ence between  the  convex  sets  for  control  and  experimental,  either  for  the 
college  or  the  high  school  freshmen.   In  terms  of  the  observed  values  (ab- 
scissa) the  high  school  freshmen  have  higher  values  than  the  college  fresh- 
men.  In  terms  of  (0  -  E)  the  dispersion  is  greater  for  the  high  school 
freshmen  than  for  the  college  freshmen. 

The  same  type  of  comparison  for  problem  41A,  (Figures  18  and  20)  shows 
the  same  characteristics.   Notice  that  in  Figure  14,  there  is  not  a  clear 
difference  for  the  experimental  and  control  subjects  using  problem  26,  but 
the  same  comparison,  when  using  problem  41A  (Figure  18)  shows  that  there  is 
a  wider  dispersion  of  tactics  for  control  in  terms  of  observed  as  well  as  in 
terms  of  (0  -  E)  values.   This  trend  seems  to  also  be  discernible  in  Figure 
20  for  problem  41A  in  college  students.   The  smaller  height  of  the  convex 
sets  shown  by  the  experimental  subjects  could  be  interpreted  as  indicating 
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more  agreement  among  themselves  than  in  the  case  of  the  control  subjects. 

Since  the  vertical  dimension  indicates  (0  -  E)  values,  where  the  ex- 
pected are  randomly  obtained,  this  seems  to  indicate  that  in  terms  of  group 
norms,  college  students  depart  less  from  random  than  high  school  freshmen. 
This  is  a  surprising  finding  and  seems  to  disagree  with  what  has  been  said 
in  the  rest  of  this  text. 

When  comparing  high  school  and  college  freshmen  using  schemata  norms, 
in  problem  26  (Figures  15  and  17),  we  find  that  for  the  high  school  fresh- 
men (Figure  15)  the  convex  set  corresponding  to  the  experimental  subjects 
shows  higher  observed  values  than  the  set  for  the  control  subjects,  and  that 
the  same  trend  is  found  for  the  (0  -  E)  values.   Notice  that  the  (0  -  E) 
values  are  higher  for  the  college  freshmen  than  for  the  high  school  fresh- 
men. 

For  problem  41A  (Figures  19  and  21)  the  same  trend  holds,  but  more 
clearly.  That  is,  while  in  terms  of  observed  values  there  is  not  much  dif- 
ference between  control  and  experimental  at  the  high  school  level  (Figure 
19),  there  is  a  clear  differentiation  in  favor  of  the  experimental  subjects 
at  the  college  level  (Figure  21).  Also  the  values  for  (O  -  E)  are  higher  in 
college  students  and  always  greater  for  the  experimental  subjects. 

It  may  be  appropriate  to  point  out  again  the  fact  that,  in  terms  of 
group  norms,  ^he  college  students  departed  much  less  from  randomness  than 
the  high  school  freshmen,  but  that,  in  terms  of  schemata  norms,  the  findings 
are  exactly  the  opposite.  This  suggests  very  strongly  the  inadequacy  of 
group  norms.   It  would  require  a  "tour  de  force"  to  interpret  those  results 
otherwise,  since  all  the  previous  evidence  shows  that  college  freshmen 
behave  "better"  than  high  school  freshmen  in  the  performance  of  the  tests. 
The  convex  sets,  as  here  discussed,  bring  this  characteristic  into  a  clearer 
focus. 

Also,  problem  41A  turns  out  to  be  a  better  instrument  than  problem  26. 
Another  point  of  interest  relates  to  the  corners  of  the  convex  sets  and  the 
tactics  that  define  them.   It  had  been  suspected  for  a  while  that  families 
of  tactics  can  be  described  along  the  boundaries  of  the  sets.  This  seems 
to  be  borne  out  in  raw  data  and  more  clearly  so  for  those  sets  based  on  the 
schemata  than  those  based  on  group  norms,  though  these  latter  ones  also 
seem  to  follow  the  same  trend. 

By  the  way  in  which  our  sets  have  been  presented,  the  dominant  tactics 
should  align  themselves  on  the  upper  boundaries  of  the  sets,  and  as  we  curve 
from  top  left  to  bottom  right  and  then  again  to  top  left,  a  progressive 
change  in  the  sequences  corresponding  to  the  tactics  should  be  observed. 
Here,  we  shall  not  discuss  points  of  maximum  and  minimum  and  mixed  tactics, 
but  it  ia  clear  that  any  tactic  could  be  expressed  as  a  linear  function  of 
any  two  or  more  tactics  following  on  the  same  straight  line. 
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For  problem  41A,  the  schemata  are  as  follows  (the  numbers  represent 
questions) : 

1,  5,  6,  9,  3 

1,  6,  9,  5,  3 

1,  6,  9,  3,  5 

14,  1,  6,  9,  5,      3 

14,  1,  6,  9,  3,      5 

14,  1,  5,  6,  9,   3 


On  these  bases,  and  as  described  before,  values  were  assigned  to  the 
questions.  Looking  at  Figure  21,  for  experimental,  we  find  that  tactic  2 
corresponds  to  the  sequence  1,  5,  6,  9,  3;   tactic  17  corresponds  to  the 
sequence  10,  6,  9;   tactic  9  to  sequence  3,  6,  5;   tactic  5  to  sequence  6, 
3,  8,  15;   and  tactic  7  to  sequence  1,  6,  3,  2,  13,  8,  11,  5,  9.   By  com- 
paring these  sequences  we  find  that  those  in  the  upper  left  corner  agree 
more  closely  with  the  schema,  and  that  those  along  the  lower  boundaries  agree 
less,  with  the  exception  of  those  approaching  the  top  left  corner. 

Much  work  is  needed  to  clarify  some  of  the  new  findings  that  may  be 
forthcoming  using  this  approach.   The  reader  is  invited  to  peruse  Figures 
14  to  21,  and  interpret  the  tactics  in  each  one  of  them,  using  the  sequences 
given  at  the  bottom  of  each  figure.   For  problem  26,  the  schemata  were: 
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The  possibility  of  evaluating  any  tactic  as  a  function  of  others  does 
not  seem,  at  the  present,  such  a  far  away  goal,  and  we  expect  to  explore 
this  possibility  further. 

In  this  report,  because  of  lack  of  time,  no  explanation  of  the  convex 
sets  corresponding  to  questions  not  asked  will  be  attempted. 
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Figure  14.   Limits  of  Performance  of  Ignatius  Control  and  Experimental 
Subjects  on  Problem  26  Based  on  Group  Norms. 


Control  Tactics 
2-1,2,3,4,7,8,9,6 
J2Q-1,2, 3,4,7 
21-1,6,7,10 
16-12,10,5,11 
2-1,9,7,2,3,4,12,11,10 
8-1,2,6,3,7,8,4,9,13,14,5,12,11,10 
18-1,2,3,4,9,13,7,8,6,14,12 


Experimental  Tactics 
5-1,2,3,4,7,9,6 
25-1,9,6,13 
2-6,7,8 
6-4,6,11 

15-1,6,9,7,4,3,8,10,5,2 
17-1, 2, 3, 4, 7, 6, 9, 13, 5, 14, 11, 10, 1 
16-1,2,3,4,7,8,9,6,11 


Note:  In  the  above  figure  and  the  following  convex  sets  an  unbroken  line 
depicts  experimental  performance  and  a  broken  line  depicts  control  performance. 
Likewise  in  all  the  convex  sets  Ignatius  refers  to  performance  of  high  school 
subjects  and  Loyola  refers  to  college  subjects. 
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Figure  15.   Limits  of  Performance  of  Ignatius  Control  and  Experimental 
Subjects  on  Problem  26  Based  on  Schemata  Norms. 


Control  Tactics 
12-1,2,6,7,8,9,5 
21-1,6,7,10 
.16-12,10,5,11 
8-1,2,6,3,7,8,4,9,13,14,5,12,11,10 


Experimental  Tactics 
13-1,7,9,6,8,13,5 
1-1,6,7,8,9 
25-1,9,6,13 
2-6,7,8 
6-4,6,11 
17-1,2,3,4,7,6,9,13,5,14,11,10,! 
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Figure  16.   Limits  of  Performance  of  Loyola  Control  and  Experimental 
Subjects  on  Problem  26  Based  on  Group  Norms. 


Control  Tactics 
.13-1,6,11,9,7,4,3,8,10,2 
7-1,2,3,6,7,9,14 
5-1,6,3,9,7,8 
4-1,7,9,6,8. 
21-1,9,8,3,6 
22-3,7,1,2,4,6,10 
25-13,14,7,8,1,12,6,5,3 
15-1, 10, 11, 12, 2, 3, 4, 6, 5, 9, 7, ( 


Experimental  Tactics 
19-1,2,3,6,7,12,9 

18-1,2,3,9,6 

2-9,7,3,6 

14-7,14,13,8,9,2 

11-6,10,11,8,12,14,3,7,13,5,4,9 

13-1,2,4,9,7,6,14,8 
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Figure  17.   Limits  ot  Performance  of  Loyola  Control  and  Experimental 
Subjects  on  Problem  26  Based  on  Schemata  Norms. 


Control  Tactics 
4-1,7,9,6,8 
21-1,9,8,3,6 
22-3,7,1,2,4,6,10 
_25-13,14,7,8,l,12,6,5,3 
L5-l,2,3,4,6,12 
13-1,6, 11, 9, 7, 4, 3, £,10, 2 
20-1,6,7,4,9,3,10,8,5 
10-1,6,2,7,8,11,4,9 


Experimental  Tactics 
3-1,9,7,6,8 
2-9,7,3,6 
14-7,14,13,8,9,2 
11-6,10,11,8,12,14,3,7,13,5,4,9 
5-1,6,7,9,2,3,8 
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Figure  18.   Limits  of  Performance  of  Ignatius  Control  and  Experimental 
Subjects  on  Problem  41A  Based  on  Group  Norms. 


Control  Tactics 
42-1,5,6,3 
40-1,5 
32-5,14,4,3 

31-15,13,4,1,3,6,14,8,5 
33-1,4,6,10,11,12,3,5,15,14,13,2 
29-1,5,6,11,3,15,13,4,8,9 
34-1,11,14,2,13,6,9,3,5 


Experimental  Tactics 
3-14,1,3,13,5,9 
13-14,13,6,3 
15-1,15,13 
11-6,9,15 

20-4,3,11,14,10,15 
22-8,4,3,9,11,5,10,13 
5-14,11,6,10,9,3,13,5 
1-14,8,4,1,6,9,3,5 
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Figure  19.   Limits  of  Performance  of  Ignatius  Control  and  Experimental 
Subjects  on  Problem  41A  Based  on  the  Schemata  Norms. 


Control  Tactics 
42-1,5,6,3 
36-1,5,6 
40-1,5 
32-5,14,4,3 
44-6,11,3,15,13,5,10 
31-15,13,4,1,3,6,14,8,5 
33-1,4,6,10,11,12,3,5,15,14,13,2 
29-1,5,6,11,3,15,13,4,8,9 


Experimental  Tactics 
4-1,9,6,5,3 
2-1,5,3,9 
15-1,15,  13 
11-6,9,15 
16-6,3,13,10,8,11 
1-14,8,4,1,6,9,3,5 
21-12,1,11,5,2,6,3,9 
5-14,11,6,10,9,3,13,5 
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Figure  20.   Limits  of  Performance  of  Loyola  Control  and  Experimental 
Subjects  on  Problem  41A  Based  on  Group  Norms. 


Control  Tactics 
9-1,6,9,3,13,11,5 
3-1,6,9,3,5 
21-1, 6,5,5 
.14-7,5,6,9 
2-6,3,5,9 

_18-2,5,6,15,12,13,10,11,4,3 
17-14,1,6,10,8,3,11,2,13,5 


Experimental  Tactics 


10-5,6,3,9 

17-10,6,3 

9-3,6,5 

5-6,3,8,13 

19-5,6,13,1,3,14,4,8,10 

7-1,6,3,2,13,8,11,5,9 

4-1,6,11,3,13,5,9 
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Figure  21.   Limits  of  Performance  of  Loyola  Control  ana  Experimental 
Subjects  on  Problem  41A  Based  on  Schemata  Norms. 


Control  Tactics 
3-1,6,9,3,5 
8-1,5,6,3 
2-6,3,5,9 

LL-5,14,13,8,6,9,3 
25-6,12,1,3,13,14,5,10 
1_8-2,5,6,15,12,13,10,11,4,3 
17-14,1,6,10,8,3,11,2,13,5 


Experimental  Tactics 
2-1,5,6,9,3 
17-10,6,9 
9-3,6,5 
5-6,3,8,13 
7-1,6,3,2,13,8,11,5,9 
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Chapter  VI 
Conclusions  And  Implications 


This  study  aims  at  finding  how  problem  solving  is  influenced  by  train- 
ing when  subjects  are  not  specifically  instructed  as  to  the  "best"  approach 
to  be  followed  in  the  solution  of  a  problem.  Upon  completion  of  the  prob- 
lems, subjects  were  invited  to  review  their  approach  before  proceeding  with 
the  next  problem.   The  design  of  the  research  was  directed  to  show  whether 
this  type  of  training  had  any  effect  on  performance,  whether  different  age 
and  educational  groups  were  affected  differentially  by  it,  and  whether 
training  in  one  type  of  problems  would  carry  over  to  other  types  of  problems. 

Behind  these  concrete  and  practical  objectives,  some  basic  issues  were 
involved.   These  issues  have  implications  for  test  theory  and  for  the  psy- 
chological interpretation  of  thinking. 

In  the  first  place,  we  were  interested  in  the  analysis  of  the  sequence 
of  questions  (tactics)  followed  by  a  subject  in  order  to  obtain  the  infor- 
mation he  needs  to  solve  a  problem.   This  considers  the  subject  as  an  active 
searcher  of  information  rather  than  as  a  passive  receptor  of  stimuli.   Thus, 
the  study  of  the  responses,  though  still  valid,  becomes  less  important  than 
in  those  approaches  in  which  thinking  processes  are  interpreted  exclusively 
considering  the  final  answer. 

The  present  study  shows  that  it  is  not  possible  to  find  a  clear  re- 
lationship between  process  and  final  answer.   The  latter  being  either  wrong 
or  correct  classifies  subjects  into  two  groups,  while  the  processes,  because 
of  their  variety  are  a  more  precise  indication  of  the  individual  differences 
that  may  exist.  As  a  matter  of  fact,  many  individual  differences  may  be 
clouded  because  of  this  manner  of  procedure.   Summarizing  the  results  ob- 
tained, it  seems  clear  that  for  a  closer  look  at  thinking  processes,  the 
solution  of  a  problem  may  be  a  biased  or  unreliable  indicator  of  them.   Fur- 
ther, it  would  be  difficult  through  the  study  of  the  answers  to  justify  an 
experimental  interpretation  of  processes.  At  most,  this  could  be  an  infer- 
ence attempting  to  explain  what  goes  on  in  the  subject's  mind  through  the 
funnel  of  a  preconceived  hypothesis.   This  type  of  behavior  may  be  endlessly 
repeated  with  varying  degrees  of  success  and  failure  but,  in  order  to  mini- 
mize the  experimenter's  bias,  there  is  not  yet  a  better  substitute  than  to 
observe  what  happens  by  getting  closer  to  the  process.   This  is  exactly  what 
we  tried  to  do  in  this  research.   It  seems  that  this  study  strengthens  our 
belief  that  the  high  points  needed  for  a  better  understanding  and  explanation 
of  the  dynamics  of  thinking  may  not  only  be  in  the  study  of  the  final  answers 
to  a  set  of  problems,  but  in  the  processes  that  lead  to  them.   Originality 
in  thinking,  high  talent  and  perhaps  creativity,  are  not  only  a  question  of 
getting  more  answers  correct,  but  also,  of  the  way  in  which  these  answers  are 
reached. 
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If  these  processes  can  be  graphically  presented,  then  the  comparison 
between  individuals  is  readily  made,  at  least  at  the  observational  level. 
For  this  purpose,  of  the  several  approaches  that  were  developed,  two  of  them 
were  used  in  this  research.   One  of  them  referred  to  group  norms  and  the 
other  to  norms  developed  following  the  schemata. 

In  relation  to  the  schemata,  their  definition  and  control  was  cne  of 
the  main  issues  involved.  As  a  matter  of  fact,  any  thinking  process  may  be 
conceived  as  reflecting  the  logical  relationships  within  the  problem  itself 
and/or  the  development  by  the  subject  of  a  logical  set  of  relationships  made 
real  by  conventional  codings.   The  logical  sets  are  called  schemata,  the 
conventional  codings  are  the  contents  used. 

By  controlling  the  schemata  it  can  be  investigated,  by  the  sequence  of 
questions  asked,  whether  a  subject  understood  the  schema  prepared  by  the 
experimenter  or  whether  his  logical  set  of  relationships  was  different  to 
the  one  embodied  in  the  problem.  A  graded  program  of  schemata  was  developed 
and  each  schema  was  realized  using  various  types  of  content.   These  contents 
were  arbitrarily  assumed  to  represent  material  of  varying  degree  of  famili- 
arity. 

In  terms  of  the  schemata,  sets  of  scoring  norms  were  prepared.  These 
norms  are  heavily  influenced  by  the  properties  of  the  problem  itself.   (In 
the  near  future,  we  intend  to  analyze  the  dimensionality  of  the  schemata. 
This  will  be,  as  it  were,  a  control  on  our  own  subjectivity  in  defining 
schemata.) . 

When  comparing  performance  curves  developed  in  terms  of  group  norms 
and  in  terms  of  schemata,  it  becomes  clear  that  the  former  give  a  distorted 
view  of  each  subject's  process,  by  confusing,  as  it  were,  the  behavior  shown 
by  each  subject  and  the  properties  of  the  problems  into  a  misleading  set  of 
values.  This  we  have  called  extrinsic  difficulty  to  differentiate  it  from 
the  intrinsic  difficulty,  related  to  the  schema. 

Analyzing  the  plateaux  (from  the  curves  based  on  schemata  norms),  it  is 
clear  that  both  schemata  and  content  contribute  significantly  to  performance, 
and  that  training  affects  both  differentially.   This  seems  to  follow  the 
same  pattern  in  both  high  school  and  college  freshmen,  though  the  latter  are 
consistently  superior  to  the  former.   Since  plateaux  can  be  interpreted  as 
indicating  defective  planning,  this  may  have  important  connotations  in  terms 
of  training,  and  how  this  training  may  be  expected  to  be  effective  in  terms 
of  increasing  the  subject's  ability  to  deal  with  progressively  more  compli- 
cated sets  of  logical  relationships  and/or  dealing  with  material  of  decreas- 
ing familiarity. 

The  design  of  the  experiment  permits  testing  the  influence  that  train- 
ing in  problems,  where  the  subjects  generate  their  own  questions  (type  b) , 
has  on  those  where  the  subjects  choose  questions  from  a  given  set  (type  a), 
and  vice  versa.  Problems  of  type  b  consisted  of  drawings  in  which  lines, 
areas  and  shapes  were  controlled  by  the  experimenter. 
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The  findings  indicate  a  transfer  of  training  more  noticeable  when  sub- 
jects were  trained  in  problems  of  type  a.   This  result  may  be  due  to  the 
fact  that  our  understanding  and  control  of  problems  of  type  a  was  better 
than  for  problems  of  type  b.  As  a  matter  of  fact,  there  is  greater  doubt 
concerning  the  schemata  for  problems  of  type  b  than  for  those  of  type  a,  with 
the  addition  that  in  the  former  a  larger  number  of  variables  tray  be  affecting 
performance.   Nevertheless,  in  the  final  testing  sessions,  it  was  found  that, 
whether  subjects  have  been  trained  first  in  problems  of  type  a  or  in  problem, 
of  type  b,  the  final  result  was  the  same,  as  judged  in  terms  of  the  problems 
administered  in  the  post-testing  session. 

There  is  a  great  temptation  to  evaluate  "goodness"  of  performance  by 
considering  number  of  questions  asked,  under  the  assumption  that  those  sub- 
jects who  ask  less  questions  are  able  to  handle  the  information  more  pre- 
cisely, that  is,  to  draw  more  and  better  conclusions  from  less  questions. 
But,  of  oourse,  the  opposite  assumption  may  also  be  defended  if  it  is  assumed 
that  the  "best"  subjects  would  like  to  have  as  much  information  as  possible 
before  reaching  a  solution.   In  this  case  more  questions  would  indicate 
better  ability.   Early  in  our  exploration  of  this  area,  we  found  that  psy- 
chologists and  educators  were  clearly  divided  on  this  issue.   For  instance, 
when  a  technique  like  the  one  used  in  this  study  was  applied  to  the  study  of 
medical  diagnostic  processes,  several  instructors  reported  that  the  best 
students  are  those  who  ask  as  many  questions  as  possible  (Rimoldi,  Haley, 
Fogliatto,  1962).  However,  it  was  also  mentioned  that  one  of  the  shortcom- 
ings often  observed  in  students  was  the  fact  that  they  did  not  know  how  tc 
combine  important  information  in  their  diagnostic  performances, 

These  differences  in  opinion  seem  to  be  related  to  a  lack  of  a  clear 
definition  of  educational  aims.   If  the  purpose  of  an  educational  program 
is  to  have  subjects  acquire  as  much  information  as  possible,  then  a  great 
number  of  questions,  including  those  that  may  be  only  slightly  relevant  to 
the  problem  at  hand,  would  be  an  indication  of  "good"  performance.   But,  if 
the  aim  of  an  educational  program  is  to  allow  people  to  handle  and  interpret 
information  more  thoroughly,  then  accumulation  of  information  per  se  may  not 
be  the  most  desirable  aim.  As  a  matter  of  fact,  it  is  our  feeling  that  a 
Doint  of  diminishing  returns  is  reached  in  problem  solving  performances  when 
too  much  information  that  is  not  completely  pertinent  is  manipulated,  and 
that  often  a  premium  is  placed  on  accumulating  information  rather  than  or. 
using  it  in  the  most  effective  way.   Indeed,  the  most  effective  way  may  be  a 
large  number  of  ways,  each  one  of  them  highly  personal.   If  this  is  properly 
considered,  then  originality  in  thinking  can  not  be  evaluated  in  terms  of 
group  performances  that  by  necessity  will  punish  some  of  those  that  deviate 
from  a  group  norm. 

All  our  experience  on  this  matter  tends  to  indicate  that  with  increased 
experience  and  knowledge,  subjects  ask  less  questions  and  eliminate  those 
that  are  irrelevant.   In  this  study,  the  same  trend  was  found,  that  is, 
college  students  on  the  whole  ask  for  less  questions  than  high  school  students 
and  experimental  subjects  also  ask  for  less  questions  than  control  subjects. 
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If  an  interpretation  of  these  findings  is  permitted,  a  possible  explanation 
could  be  that  with  increased  knowledge  and  increased  experinece,  more  dis- 
crimination is  made  between  what  is  relevant  and  what  is  not  and  more  atten- 
tion is  paid  to  the  understanding  of  the  problem  and  to  the  planning  of  the 
tactic  that  the  subject  considers  is  most  likely  to  succeed.   This  inter- 
pretation draws  together,  on  the  whole,  information  coming  from  this  study. 

This  investigation  seems  to  indicate  that  tactics  and  number  of  ques- 
tions asked  are  not  clearly  related  to  number  of  correct  solutions  to  the 
problems  administered.   This  sane  finding  has  been  found  in  other  studies. 
Here  again,  the  question  of  evaluation  depends  on  a  statement  of  aims.   It 
has  been  found  (Rimoldi,  Meyer,  unpublished)  that  when  old  persons  of  high 
educational  level  are  administered  some  of  the  usual  IQ  tests,  th^ir  scores, 
though  lower  in  general  than  those  of  younger  subjects,  are  high  in  terms  of 
the  norms.   Nevertheless,  in  instruments  that  are  less  dependent  on  everyday 
experience,  like  Raven's  Progressive  Matrices  Test  and  in  our  type  of  prob- 
lems, their  performances  are  very  poor.  As  a  matter  of  fact,  a  graphic  way 
of  expression  would  be  to  say  that  they  "refuse"  to  think.   Nevertheless,  as 
implied  by  their  IQ's,  they  answer  correctly  many  of  the  items  of  the  test. 

We  shall  not  discuss  here  all  the  implications  of  these  observations , 
but  only  point  to  the  fact  that,  familiarity  or  good  "conditioning"  to  the 
requirements  of  the  usual  environment  may  not  necessarily  be  an  indication 
of  high  thinking  ability.   In  some  situations,  this  may  be  a  very  important 
issue,  for  instance,  for  the  appraisal  of  high  talent.   It  is  almost  an 
aphorism  that  in  scientific  research,  what  matters  is  not  exclusively  to 
obtain  clear-cut  solutions  to  problems,  but  rather  to  plan  the  attack  that 
will  bring  about  more  fruitful  results.  As  a  matter  of  fact,  the  history  of 
science  shows  that  those  scientists  who  have  distinguished  themselves  have 
been  able  to  get  into  the  riddle  of  a  problem  by  asking  pertinent  questions 
that  may  or  may  not  give  the  "correct"  solution  to  the  issue  at  hand.  Thus, 
if  our  design  and  instruments  are  considered  to  be  directed  towards  the  study 
of  thinking,  it  is  not  surprising  to  find  out  that  "correctness"  of  the  final 
answers  may  not  be  a  good  indicator  of  them. 

The  study  of  the  ellipsoids  shows  that  the  experimental  subjects  agree 
among  themselves  better  than  the  controls.  Also,  that  college  students  are, 
on  the  whole,  better  than  high  school  students.  The  norms  used  here  are 
based  on  group  performances,  and  thus  cloud  individual  differences.   The 
importance  of  this  finding  is  then  in  showing  how  training  may  increase 
agreement. 

A  large  number  of  mathematical  and  statistical  methods  were  either 
adapted  or  invented  for  the  purposes  of  this  research.   It  should  be  obvious 
that  the  usual  techniques  could  not  always  be  applied  to  our  data.   Some  of 
these  are  not  yet  completely  developed,  others  lack,  as  yet,  an  appropriate 
test  of  significance,  and  still  others  are  in  an  embryonic  state.   These 
techniques  have  been  described  in  the  body  of  the  text  or  in  already  pub- 
lished studies. 
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In  relation  to  improvement  of  school  grades  in  those  subjects  that  were 
trained  with  the  problems  here  described,  nothing  definite  can  be  reported, 
though  it  seems  clear  that  experimental  subjects  gained  more  than  control 
subjects  in  their  average  grades  (mid  and  final  grades). 

In  this  report  we  have  not  presented  the  complete  analysis  of  our  data 
because  of  lack  of  time  and  help.   This  analysis  we  expect  to  complete  in 
the  future. 

The  implications  of  this  research  in  areas  other  than  education  extend 
to  the  study  of  changes  in  thinking  processes  with  age,  in  abnormal  condi- 
tions, and  under  the  effects  of  pharmacological  agents,  as  well  as  to  the 
early  detection  of  high  talent  in  specific  fields,  such  as  mathematics. 
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THOUGHT  PROBLEMS,  PART  I 


Directions:   On  the  following  pages  there  are  20  thought  problems.   Some 
are  hard,  but  you  can  solve  most  of  them  if  you  read  and  re-read  carefully, 
think  straight,  and  take  enough  time.   If  you  find  some  extremely  hard^  go  on 
to  the  next  one  and  return  to  the  hard  ones  later. 

In  the  problems  which  require  figuring  on  paper,  please  use  the  space 
provided  and  the  margin  of  the  page.   Be  sure  to  show  all  of  your  figures  so 
that  credit  can  be  given  for  correct  steps  even  though  your  answer  may  be 
wrong. 


DO  NOT  TURN  THIS  PAGE  UNTIL  YOU  ARE  TOLD  TO  DO  SO. 


Appendix  I 


In  our  school  two-thirds  of  the  boys  play  football  and  two-thirds  play 
basketball.  Of  the  following  statements,  which  is  necessarily  true? 

Some  boys  play  neither  football  nor  basketball. 
Some  boys  play  both  football  and  basketball. 

In  a  certain  school  the  positions  of  principal,  assistant  principal,  and 
coach  were  held  by  Green,  Burns,  and  Smith,  though  not  necessarily  in  that 
order.   The  principal,  who  was  an  only  child,  earns  the  most.   Burns,  who 
married  Green's  sister,  earns  less  than  the  coach. 

What  position  is  held  by  Green? 

What  position  is  held  by  Burns? 

What  position  is  held  by  Smith? 

When  you  enter  my  house  you  will  find  a  window  on  your  right  in  the  side 
wall  of  the  entry.   When  the  sun  sets  it  shines  straight  through  this 
window  on  the  opposite  wall.   What  direction  are  you  facing  when  you  stand 
in  the  doorway  and  look  accross  the  street? 


Suppose  that  the  Yankees  lead  the  league  and  that  the  Red  Sox  are  fifth, 
while  the  White  Sox  are  midway  between  them.   If  the  Indians  are  ahead 
of  the  Red  Sox  and  the  Tigers  immediately  behind  the  White  Sox,  which 
team  is  in  second  place? 


In  a  farmer's  papers,  a  receipt  was  found:   24  dozen  eggs  ....  $_2.4_>. 
The  first  and  last  digit  of  the  amount  had  oeen  blotted  out. 

What  are  the  two  missing  digits? 

What  was  the  price  of  a  dozen  eggs? 

I  started  free,  the  school  and  walked  100  yards;   I  turned  to  the  right  and 
walked  50  yaros;   I  turned  to  the  right  again  and  walked  100  yards.  How 
far  from  the  school  am  I? 


There  are  six  nush  buttons  lettered  A,  B,  C,  D,  E,  F.   Two  of  the  buttons 
will  ring  a  bfeil,  four  will  not.   The  buttons  can  be  pushed  in  combin- 
ations only  cf  three.   It  is  known  that: 

CoLcbination  A,  B,  C  rings  the  bell. 

Cotnbf.r.atic-.i  E,  C,  E  does  not  ring  the  bell. 

Cotn.binati.cn  G,  D,,  E  rings  the  bell. 

Con  .  ..nati •__-.  B,  G  .  D  rings  the  bell. 

Conb.uiatic-a  D,  V  F  rings  the  bell. 
Which  two  buttons  are  connected  with  the  bell? 
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My  birthday  is  on  December  27,  and  I  am  just  four  days  older  than  Tom. 
This  year  Christmas  day  comes  on  Tuesday.   On  what  day  of  the  week  is  Tom's 
birthday? 


A  pound  of  meat  should  roast  for  half  an  hour;   two  pounds  of  meat  should 
roast  for  three-quarters  of  an  hour;   three  pounds  of  meat  should  roast  for 
one  hour;   eight  pounds  of  meat  should  roast  for  two  hours  and  a  quarter. 
If  you  were  writing  a  cookbook,  how  would  you  state  the  rule  by  which  a 
person  could  tell  from  the  weight  of  a  piece  of  meat  how  long  it  should 
roast? 


10.  Three  playing  cards  are  placed  in  a  row,  face  down.  To  the  right  of  a  King, 
there  are  one  or  two  Queens.   To  the  left  of  a  Queen,  there  are  one  or  two 
Queens.  To  the  left  of  a  heart,  there  are  one  or  two  spades.   To  the  right 
of  a  spade,  there  are  one  or  two  spades.  One  of  the  cards  is  the  Queen  of 
hearts.  What  are  the  other  two? 


11.  The  witness  said,  "I  heard  my  clock  strike  yesterday,  about  ten  minutes  be- 
fore the  shot  was  fired.   I  did  not  count  the  chimes,  but  I'm  sure  it 
struck  more  than  once  and  that  it  struck  an  odd  number.   The  witness  had 
been  out  all  morning  and  her  clock  stopped  at  5  minutes  to  5  the  same 
afternoon.   When  do  you  think  the  shot  was  fired? 

12.  If  the  A's  have  a  bigger  army  than  B's,  we  ought  first  either  to  fight  the 
B's  or  attack  the  C's  by  sea,  but  not  attack  the  A's.   If  the  A's  amy  is 
smaller,  we  should  attack  the  A's  first.   If  the  C's  have  a  bigger  navy 
than  we,  we  ought  to  either  fight  the  B's  or  the  A's,  but  not  the  C's.   If 
C's  navy  is  smaller,  we  should  first  attack  the  C's  by  sea.   The  sizes  of 
armies  and  navies  are  - 

Men  Ships 

A   7,000,000  300 

B   5,000,000  400 

C   4,000,000  500 

Ourselves    6,000,000  200 

Whom  should  we  attack  first? 

13.  A  cube  is  3  inches  on  each  side.   It  is  painted  red,  then  sliced  up  into 
one -inch  cubes. 

How  many  one-inch  cubes  will  there  be?        ___________ 

How  many  one-inch  cubes  will  have  3  red  sides?  ________________ 

How  many  one-inch  cubes  will  have  2  red  sides? 

How  many  one-inch  cubes  will  have  1  red  side? 

How  many  one>-inch  oubcs  will  have  no  j.t»d  eido?  ^_ 
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14.  Bill  came  home  with  a  new  bicycle.   There  is  clay  on  his  feet  and  soot 

on  his  forehead.   The  only  places  he  can  have  been  are  West  Philadelphia, 
North  Philadelphia,  South  Philadelphia,  and  Camden.  He  has  not  had  time 
to  go  to  more  than  one  of  these.  There  are  bicycle  shops  only  in  North 
Philadelphia,  West  Philadelphia,  and  Camden.  There  is  soot  in  the  air 
only  in  North  Philadelphia,  South  Philadelphia,  and  Camden.   The  streets 
are  not  being  repaired  in  North  Philadelphia,  but  they  may  be  in  other 
places.   Where  had  Bill  been? 


15.   In  numbering  the  pages  of  a  book  a  printer  used  111  digits.   (The  digits 
are  0,1,2,3,4,5,6,7,8  and  9.)  How  many  pages  has  the  book? 


16.  There  are  six  push  buttons  lettered  D,  E,  F,  G,  H,  I.   Two  of  the  buttons 
acting  together  ring  a  bell.   The  buttons  can  only  be  pushed  in  combin- 
ations of  three.   It  is  known  that: 

Combination  DEF  does  not  ring  the  bell. 
Combination  EFG  does  not  ring  the  bell. 
Combination  FGH  rings  the  bell. 
Combination  GHI  does  not  ring  the  bell. 
Which  two  buttons  acting  together  ring  the  bell? 

17.  What  idea  can  you  draw  from  the  following  facts?  Iron  nails  will  not 
float  in  a  pool;   a  cup  of  pure  gold  dust  weighs  nearly  twenty  times  as 
much  as  a  cup  of  water  the  same  size;   if  you  drop  a  dime  or  penny  into 
a  puddle  it  will  sink  to  the  bottom;  a  leaden  weight  will  drop  to  the 
bottom  of  the  ocean;   a  cubic  inch  (about  a  tablespoon)  of  water  weighs 
less  than  half  an  ounce,  while  a  cubic  inch  of  brass  weighs  over  two 
ounces.   Sum  up  all  these  facts  into  one  short  statement: 

Most  are . 

18.  Where  the  climate  is  hot,  bananas  and  rubber  trees  will  grow.   Straw- 
berries and  potatoes  will  grow  where  it  is  cool.   Strawberries  and  rubber 
trees  require  plenty  of  moisture;   potatoes  and  bananas  need  fairly  dry 
regions.   Near  the  Amazon  river  it  is  very  hot  and  very  damp.   Which  of 
the  above  grows  there? 

19.  A  broker  bought  5  shares  of  stock  at  $10  each  which  he  sold  at  $8  each. 
But  he  sold  at  $3  each  some  shares  he  had  bought  at  $2  each.   If  his 
profit  was  $15,  how  many  shares  did  he  sell  at  $3? 


20, 


On  a  six-day  vacation,  John  drank  twice  as  much  coke  each  day  as  he  did 
the  day  before.   On  the  6th  day  he  drank  a  quart.   On  what  day  did  he 
drink  a  pint? 
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Name  School  Date 


THOUGHT  PROBLEMS,  PART  II 


Direct ions:   On  the  following  pages  there  are  20  thought  problems.   Some 
are  hard,  but  you  can  solve  most  of  them  if  you  read  and  re-read  carefully, 
think  straight,  and  take  enough  time.   If  you  find  some  extremely  hard,  go  on 
to  the  next  one  and  return  to  the  hard  ones  later. 

In  the  problems  which  require  figuring  on  paper,  please  use  the  spaces 
provided  and  the  margin  of  the  page.   Be  sure  to  show  all  of  your  figures  so 
that  credit  can  be  given  for  correct  steps  even  though  your  answer  may  be 
wrong. 


DO  NOT  TURN  THIS  PAGE  UNTIL  YOU  ARE  TOLD  TO  DO  SO. 
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21.  Some  children  were  asked:   "Why  are  towns  nearly  always  more  unhealthy 
than  the  country?"  They  gave  the  following  replies:   (Underline  the 
best  two  replies.) 

"Some  country  places  are  by  the  seaside." 

"There  are  more  doctors  in  the  town." 

"The  smoke  and  fumes  in  the  city  make  the  air  less  pure." 

"People  in  the  country  sleep  more." 

"Diseases  spread  more  where  people  are  crowded  together." 

22.  The  doctor  thinks  Jack  has  caught  some  disease.   If  he  has  a  rash,  it  is 
probably  chicken-pox,  measles,  or  scarlet  fever.   If  he  has  been  ailing 
with  a  cold  or  cough,  he  may  develop  whooping-cough,  measles,  or  mumps. 
He  has  been  sneezing  and  coughing  for  some  days,  and  now  spots  are 
appearing  on  his  face  and  arms.   What  disease  does  Jack  probably  have? 


23.  John  has  7  pockets  and  20  dimes.  He  wants  to  put  his  dimes  into  his 
pockets  so  that  each  pocket  contains  a  different  number  of  dimes. 

Can  he  do  so? 

Explain  your  answer. 

24.  Helen  walked  four  blocks  west  on  Elm  Street.   She  turned  left  and  walked 
two  blocks,  turned  right  and  walked  two  more  blocks,  and  then  turned 
right  again  and  walked  one  block.   Which  direction  was  Helen  walking  in 
the  last  block? 


25.     There  are  five  books  in  a  pile.   The  green  one  is  directly  under  the  blue 
one  and  is  above  the  yellow  one.  The  red  one  is  above  the  brown  one, 
but  not  next  to  it.   The  brown  book  is  directly  under  the  green  book. 
Which  book  is  on  top? 


26.  There  are  a  number  of  bacteria  in  a  flask  at  9  o'clock.   There  were  half 
as  many  at  8  o'clock;   there  will  be  twice  as  many  at  10  o'clock.  At 
this  rate  the  flask  will  be  full  at  4  o'clock.  At  what  time  will  it  be 
half  full? 


27.  After  eating  at  the  company  cafeteria,  a  number  of  workers  got  sick. 

Each  worker  had  selected  three  items  of  food  from  the  five:   ham  sand- 
wich, cole  slaw,  rice  pudding,  milk,  cocoa.   The  company  nurse  inter- 
viewed the  workers  and  found  that  those  who  had  eaten  items  ham  sandwich, 
cole  slaw,  and  milk  got  sick,  as  did  those  who  had  eaten  cole  slaw,  rice 
pudding,  and  milk.    However,  those  who  had  eaten  ham  sandwich,  cole 
slaw,  and  cocoa  didn't  get  sick.   What  two  foods  may  have  caused  the 
sickness? 
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28.  Bentonville  is  15  miles  east  of  Austin.  Centerburg  is  25  miles  north 
of  Bentonville.  Dearborn  is  75  miles  west  of  Centerburg.  How  far  is 
Dearborn  from  Austin? 


Captain  Watts  and  his  son  James  have  been  found  shot  —  the  father  in  the 
chest  and  the  son  in  the  back.   Both  clearly  died  instantaneously.  A 
gun  fired  close  to  a  person  —  as,  for  example,  when  a  man  shoots  him- 
self --  will  blacken  and  even  burn  the  skin  or  clothes;   fired  from  a 
greater  distance  it  will  leave  no  such  mark.   The  two  bodies  were  found 
near  the  middle  of  a  large  hall  used  as  a  rifle  range.   Its  floor  is 
covered  with  damp  sand  which  shows  every  footprint  distinctly.   Inside 
the  room  there  are  two  pairs  of  footprints  only.  A  third  man  standing 
just  outside  the  door  or  window  could  aim  at  any  part  of  the  room,  but 
the  pavement  outside  would  show  no  footprints.  Under  Captain  Watts' 
body  was  found  a  gun;   no  such  weapon  was  found  near  James.   In  each  case 
the  coat,  where  the  bullet  entered,  was  blackened  with  gunpowder,  and  the 
cloth  a  little  singed.   Captain  Watts  was  devoted  to  his  son,  and  would 
have  died  rather  than  harm  him  purposely;   hence  it  is  impossible  to 
suppose  that  he  killed  him  deliberately,  even  in  self-defense.   But  some 
think  that  James  secretly  disliked  his  father,  and  hoped  to  inherit  his 
fortune  at  his  death. 

Was  Captain  Watts'  death  due  to  murder,  accident,  or  suicide? 

Was  James'  death  due  to  murder,  accident,  or  suicide? 

30.  The  winning  horse  in  a  race  finished  at  4:31  P.M.  He  was  six  lengths 
ahead  of  the  second  horse,  which  finished  nine  lengths  ahead  of  the  third 
horse.   The  third  horse  ran  the  race  in  2  minutes  and  3  seconds.   In  the 
last  quarter  of  the  race,  each  horse  was  traveling  one  length  in  1/5 
second. 

How  long  did  it  take  the  winning  horse  to  win  the  race? 

At  what  time  did  the  race  start? 

31.  During  a  class  play  one  of  the  stagehands  has  to  change  the  spotlight 
from  red  to  blue.  There  are  six  switches  that  can  be  pulled.  They  are 
numbered  1,  2,  3,  4,  5  and  6.   Two  of  the  switches  will  turn  on  the  blue 
light;   the  others  will  not.   The  stagehand  knows  that  

1,2  and  3  pulled  together  will  make  the  light  blue. 

4,  5  and  6  pulled  together  will  make  the  light  blue. 

2,  5  and  5  pulled  together  will  make  the  light  blue. 

3,  4  and  6  pulled  together  will  not  make  the  light  blue. 
2,  5  and  6  pulled  together  will  make  the  light  blue. 

Which  two  switches  will  turn  the  light  blue? 
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A  fireman  stood  on  the  middle  rung  of  a  ladder,  directing  water  into  a 
burning  building.  As  the  smoke  lessened,  he  stepped  up  three  rungs  and 
continued  his  work  from  that  point.   A  sudden  flare-up  forced  him  to  go 
down  five  rungs.  Later  he  climbed  up  seven  rungs  and  worked  there  until 
the  fire  was  out.   Then  he  climbed  the  remaining  six  rungs  and  entered  the 
building.   Write  down  the  number  of  rungs  in  the  ladder. 


33.   I  am  at  cross  roads.   I  have  come  from  the  South  and  want  to  go  to 
Philadelphia.  The  road  to  the  right  leads  somewhere  else.   The  road 
straight  ahead  leads  only  to  a  farm.   In  which  direction  is  Philadelphia? 

Circle  the  right  answer:  North,  East,  South,  West. 

Four  boys,  one  of  whom  was  known  to  have  broken  a  window,  were  questioned 
by  the  principal.   Each  made  a  statement:   Dave:   "Tom  did  it."  Tom: 
"Bill  did  it."  Jack:   "I  didn't  do  it."  Bill:   "Tom  lied  when  he  said 
I  did  it."  If  only  one  of  the  four  statements  is  false,  who  is  the  guilty 
boy? 


35.  George  is  running  his  little  brother's  train  set.   He  wants  to  switch  the 
engines  onto  a  different  track.   There  are  six  colored  pushbuttons  on  the 
control  panel  -  red,  yellow,  orange,  green,  blue,  and  ourple.   Two  of  the 
pushbuttons  acting  together  will  switch  the  train  to  a  different  track. 
George  knows  that  - 

Pushbuttons  Orange,  Green,  and  purple  acting  together  will  not 

switch  tracks. 

Pushbuttons  Red,  Yellow,  and  Eluc  acting  together  will  not 

switch  tracks. 

Pushbuttons  Red ,  Yellow,  and  Orange  acting  together  will  switch 

tracks. 

Pushbuttons  Yellow,  Orange ,  and  Green  acting  together  will  not 

switch  tracks. 

Which  two  pushbuttons  acting  together  will  switch  the  tracks? 

36.  Dave  bought  the  following  Christmas  presents:   a  pipe,  some  music,  a 
carton  of  cigarettes,  a  bracelet,  a  toy  engine,  a  bat,  a  book,  a  doll, 

a  walking  stick,  and  an  umbrella.  His  brother  ie  18;   he  does  not  smoke, 
nor  play  baseball,  nor  play  the  piano.   Dave  wants  to  give  the  walking 
stick  to  his  father  and  the  umbrella  to  his  mother.  Which  of  the  presents 
shall  he  give  to  his  brother? 
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37.   Three  boxes  arc  piled  on  top  of  each  other.  All  are  of  the  same  size, 
3  by  4  by  5  feet.   The  lower  box  rests  on  its  3  by  5  side,  the  second 
box  on  its  4  by  5  side,  and  top  box  on  its  3  by  4  side.   What  is  the 
height  of  the  pile? 


38.  A  cube  is  3  inches  on  each  side.   It  is  painted  white  on  two  opposite 

sides;   red  on  two  opposite  sides;   and  blue  on  two  opposite  sides.   It 
is  then  sliced  ud  into  one-inch  cubes. 

How  many  one-inch  cubes  will  there  be?  ______ 

How  many  will  show  the  colors  red,  white,  and  blue?   _______ 

How  many  will  show  white  only? 

How  many  will  show  red  only? 

How  many  will  show  blue  only? 

How  many  will  show  two  colors  only? 

How  many  will  show  no  colors? 


39.  A  farmer  sold  5  turkeys  at  $10  each,  although  it  had  aost  him  $12  to 

raise  them.  At  the  same  time  he  sold  at  $2  each  some  chickens  in  which  he 
had  invested  only  $1  each.   If  his  profit  was  $10,  how  many  chickens  did 
he  sell  for  $2  each? 


40.   In  cold,  damp  climates,  root  crops  like  potatoes  and  turnips  grow  best. 
In  temperate  climates  there  are  many  pastures,  and  oats  and  barley  grow 
well.   In  subtropical  climates  wheat,  olives,  and  vines  grow  well.   In 
tropical  climates  date-palms  and  rice  grow  best.  The  ancient  Verfccrites 
lived  largely  on  bread,  with  oil  instead  of  butter;   they  had  wine  to 
drink  and  raisins  for  fruit.   Which  climate  do  you  think  they  had? 
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Problem  1 


Instructions  ?nd  Corresponding  Questions  and  Answers 

Figure  I  is  composed  of  an  overlapping  rectangle,  triangle,  and  circle, 
forming  the  areas  A  through  E.   You  will  notice  that  an  area  is  any  part  of 
the  figure  that  does  not  have  a  line  through  it.   B,  C,  and  D,  for  example, 
are  separate  areas,  even  though  they  are  part  of  the  same  rectangle. 

One  of  the  areas  has  been  picked  at  random.   Your  task  is  to  find  out 
which  one  it  was.   To  find  the  particular  area,  you  must  discover  enough  facts 
about  it  so  that  it  can  be  distinguished  from  the  other  areas.   You  may  dis- 
cover these  facts  by  using  any  of  the  questions  you  like  to  arrive  at  the 
answer. 

Proceed  by  reading  over  all  the  questions.   Decide  on  the  first  question 
you  would  like  to  have  answered  and  write  its  number  on  the  page  provided. 
Then  withdraw  the  card  from  the  folder,  and  read  the  answer  on  the  back  of  the 
card.  After  having  read  the  answer,  decide  on  the  next  question  you  would 
like  to  have  answered.   Write  down  its  number  and  withdraw  the  card.   When  you 
are  satisfied  that  you  have  arrived  at  the  answer,  stop  drawing  cards,  and 
write  down  your  answer.   Remember,  you  may  draw  as  many  cards  as  you  need  to 
find  the  correct  area,  but  don't  draw  any  more  than  you  need. 


Questions 

1.  Is  it  the  smallest  area?  1. 

2.  Is  it  the  largest  area?  2. 

3.  Is  it  outside  the  rectangle?  3. 

4.  Is  it  within  the  rectangle?  4. 

5.  Are  all  sides  straight?  5. 

6.  Is  it  in  two  geometric  figures?    6. 

7.  Does  it  have  at  least  three  7. 
straight  sides? 

8.  Is  one  border  curved?  8. 

9.  Is  it  in  a  triangle?  9. 


No,  it  is  not  the  smallest  area. 

No,  it  is  not  the  largest  area. 

No,  it  is  not  outside  the  rectangle, 

Yes,  it  is  within  the  rectangle. 

No,  all  sides  are  not  straight. 

Yes,  it  is  within  two  geometric 

figures. 

No,  it  does  not  have  at  least  three 

straight  sides. 

Yes,  one  border  is  curved. 

No,  it  is  not  in  a  triangle. 


Solution:   The  pre-selected  area  is  D. 
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Problem   1 
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12. 
Problem  19 


Instructions  and  Corresponding  Questions  and  Answers 

John  Smith  lives  in  a  small  city  that  has  only  three  companies.  These 
are  the  Grant  Co.,   the  Williams  Corporation,   and  the  Gibbons  Metals.   Your 
task  is  to  determine,  if  you  can,  which  company  John  Smith  works  for.  A  set 
of  questions  regarding  John  Smith  and  the  three  companies  is  presented  on 
the  cards.   The  answer  to  each  question  is  on  the  reverse  side  of  the  card. 
Look  over  all  the  questions  and  then  decide  which  question  you  would  first 
like  to  have  answered  and  tell  the  examiner.  Then  turn  over  the  card;   read 
the  answer  and  decide  which  question  you  would  next  like  to  have  answered. 
Tell  the  examiner  its  number  and  turn  over  the  card.   Proceed  in  this  way 
until  you  are  satisfied  that  you  have  the  answer  to  the  problem.   You  may  use 
as  many  questions  as  you  feel  you  need  to  answer  the  question.  However,  do 
not  use  more  questions  than  you  feel  you  need. 


Questions 

1.  What  is  Mr.  Smith's  salary? 

2.  How  much  education  has  he  had? 


3.  Is  Mr.  Smith  married  or  single? 

4.  How  old  is  Mr.  Smith? 

5.  What  kind  of  job  does  he  have? 


6.  How  long  has  he  had  his  present  job?  6, 

7.  How  long  has  he  lived  in  his  present  7, 
home? 

8.  What  is  the  name  of  the  city?  8, 

9.  Where  in  the  city  does  Mr.  Smith      9. 
live? 

10.  How  many  banks  are  there  in  the      10. 
city? 

11.  Does  Mr.  Smith  have  a  bank  account?  11. 


12.  Where  is  the  Grant  Co.? 

13.  Where  is  the  Williams  Corp.? 

14.  Where  is  Gibbons  Metals? 


Answers 

1.  His  salary  is  $8000  per  year. 

2.  He  is  a  high  school  graduate. 
He  wanted  to  go  to  college,  but 
his  family  did  not  have  enough 
money  to  send  him. 

3.  Mr.  Smith  is  married.  He  has 
three  children. 

4.  He  is  46  years  old. 

5.  He  is  Supervisor  of  a  loading 
dock. 

He  has  had  his  job  for  11  years. 
He  has  been  in  his  present  home 
for  6  years. 

The  name  of  the  city  is  Spring - 
ton. 

He  lives  at  the  North  End  of 
the  city  near  the  high  school. 
There  are  two  banks:   the  First 
National  and  the  State  Bank. 
No,  Mr.  Smith  does  not  have  a 
bank  account. 

12.  The  Grant  Co.  is  just  west  of 
the  city,  off  the  main  highway. 

13.  The  Williams  Corp.  is  north  of 
the  city,  just  accross  the 
river. 

14.  Gibbons  Metals  is  near  the 
center  of  the  city. 
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Problem  19 
(Continued) 


Questions 

15.  How  long  has  Grant  and  Co.  been  in 
the  city? 

16.  How  long  has  the  Williams  Corp. 
been  in  the  city? 

17.  How  long  has  Gibbons  Metals  been 
in  the  city? 

18.  How  much  education  does  Grant  Co. 
require  of  its  employees? 


19.   How  much  education  does  the 

Williams  Corp.  require  of  its 
employees? 


20.  How  much  education  does  the 

Gibbons  Metals  require  of  its 
employees? 


Answers 

15.  Grant  Co.  is  the  oldest  firm  in 
the  city.   It  has  been  there 
over  60  years. 

16.  The  Williams  Corp.  has  been  in 
the  city  about  15  years. 

17.  Gibbons  Metals  opened  its  plant 
in  this  city  4  years  ago. 

18.  The  policy  of  Grant  Co.  in 
recent  years  has  been  to  hire 
only  college  graduates.  As  a 
result }    all  employees  under  40 
are  college  graduates.   Some  of 
the  employees  over  40  are  only 
high  school  graduates,  while 
some  others  are  college  graduates 

19.  The  Williams  Corp.  hires  only 
college  graduates  for  super- 
visory positions.   Employees 
below  supervisor  may  be  high 
school  graduates  only. 

20.  Gibbons  Metals  has  no  policy  on 
education.   Its  employees  may 
have  any  amount  of  education. 


Solution:   Mr.  Smith  works  for  the  Grant  Co. 
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14. 
Problem  25 


Instructions  and  Corresponding  Questions  and  Answers 

The  figure  here  is  composed  of  overlapping  geometric  figures  and  lines, 
forming  twenty-five  areas.   You  will  notice  that  an  area  is  any  enclosed  part 
of  the  figure  that  does  not  have  a  line  through  it.  One  of  the  areas  has  been 
picked  at  random.   Your  task  is  to  find  out  which  one  it  was.   To  find  the 
particular  area,  you  must  discover  enough  facts  about  it  so  that  it  can  be 
distinguished  from  other  areas.   You  may  discover  these  facts  by  using  any  of 
the  questions  you  like. 

Proceed  by  reading  over  all  the  questions.  Then  decide  on  the  first 
question  you  would  like  to  have  answered,  and  write  its  number  on  the  page 
provided.  Then  take  the  card  from  the  folder,  and  read  the  answer  on  the  back 
of  the  card.  After  having  read  the  answer,  decide  on  the  next  question  you 
would  like  to  have  answered.   Write  down  its  number  and  take  the  card  from  the 
folder.   When  you  are  satisfied  that  you  have  arrived  at  the  answer,  stop 
drawing  cards,  and  write  down  your  answer.   Remember,  you  may  use  as  many  of 
the  cards  as  you  need  to  find  the  correct  area,  but  don't  draw  any  more  than 
you  need. 


Questions 

1.  Is  it  in  the  large  square?  1. 

2.  Is  it  in  the  large  circle?  2. 

3.  Is  it  in  the  small  circle?  3. 

4.  Does  the  area  have  at  least  one  4. 
right  angle? 

5.  Is  the  area  a  rectangle?  5. 

6.  Is  the  area  a  triangle?  6. 

7.  Is  it  outside  the  large  square?  7, 

8.  Is  it  outside  the  large  circle?      3. 

9.  Is  it  to  the  left  of  the  straight    9. 
dotted  line? 

10.  Is  it  to  the  right  of  the  straight  10. 
dotted  line? 

11.  Does  it  have  all  straight  line      11. 
boundaries? 

12.  Does  it  have  all  curved  boundaries?  12. 

13.  Does  the  area  have  at  least  two     13. 
boundaries? 

14.  Does  the  area  have  at  least  three   14. 
boundaries? 

15.  Does  the  area  have  at  least  four    15. 
boundaries? 


Answers 

Yes,  it  is  in  the  large  square. 

No,  it  is  not  in  the  large  circle. 

No,  it  is  not  in  the  small  circle. 

No,  it  does  not  have  at  least  one 

right  angle.  e 

No,  the  area  is  not  a  rectangle. 

No,  the  area  is  not  a  triangle. 

No,  it  is  not  outside  the  large 

square. 

Yes,  it  is  outside  the  large 

circle. 

No,  it  is  not  to  the  left  of  the 

straight  dotted  line. 

Yes,  it  is  to  the  right  of  the 

straight  dotted  line. 

No,  it  does  not  have  all  straight 

1 ine  boundar ie  s . 

No,  it  does  not  have  all  curved 

boundaries. 

Yes,  the  area  does  have  at  least 

two  boundaries. 

Yes,  the  area  does  have  at  least 

three  boundaries. 

Yes,  the  area  does  have  at  least 

four  boundaries. 
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Problem  25 
(Continued) 


Questions 

16.  Does  the  area  have  at  least  five    16, 
boundaries? 

17.  Does  it  have  at  least  two  straight   17, 
line  boundaries? 

18.  Does  it  have  at  least  three         18, 
straight  line  boundaries? 

19.  Does  it  have  at  least  four         19, 
straight  line  boundaries? 

20.  Does  it  have  at  least  two  curved    20, 
boundaries? 

21.  Does  it  have  at  least  three         21. 
curved  boundaries? 

22.  Does  it  have  at  least  four  curved   22. 
boundaries? 

23.  Does  it  have  a  dotted  boundary?     23. 

24.  Does  it  have  two  dotted  boundaries?  24. 

25.  Does  it  have  a  straight  line        25, 
boundary? 

26.  Does  it  have  a  curved  boundary?     26, 


Answers 

No,   the   area  does   not  have  at 

least  five  boundaries. 

Yes,  it  has  at  least  two  straight 

line  boundaries. 

No,  it  does  not  have  at  least 

three  straight  line  boundaries. 

No,  it  does  not  have  at  least 

four  straight  line  boundaries. 

Yes,  it  does  have  at  least  two 

curved  boundaries. 

No,  it  does  not  have  at  least 

three  curved  boundaries. 

No,  it  does  not  have  at  least 

four  curved  boundaries. 

Yes,  it  does  have  a  dotted 

boundary. 

No,  it  does  not  have  two  dotted 

boundaries. 

Yes,  it  does  have  a  straight 

line  boundary. 

Yes,  it  does  have  a  curved 

boundary. 


Solution:   The  pre-selected  area  is  #10, 
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Problem  25 
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17. 
Problem  31  A 


Instructions  and  Corresponding  Questions  and  Answers 

At  Spencer  High  School  the  annual  fall  dance  is  about  to  be  held.  A 
dance  committee  has  been  selected  to  make  the  necessary  arrangements.   Both 
boys  and  girls  are  on  the  committee.  A  part  of  the  committee  is  to  take  care 
of  the  refreshments  for  the  evening  and  another  part  will  look  after  the  sale 
of  the  tickets  for  the  dance.  The  list  of  the  girls  on  the  dance  committee 
involved  in  the  sale  of  tickets  has  been  lost.   From  the  other  information 
available,  which  you  will  find  in  the  questions,  your  object  will  be  to  dis- 
cover the  number  of  girls  involved  in  the  sale  of  tickets. 

Questions  Answers 

1.  Is  Spencer  High  School  the  only        1.   No. 
coeducational  school  in  the  city? 

2.  How  many  boys  attend  Spencer  High?     2. 

3.  How  many  boys  are  on  the  dance         3. 
committee? 

4.  Are  there  more  girls  than  boys  at      4. 
this  school? 

5.  How  many  students  on  the  dance  com-    5. 
mittee  are  assigned  to  supplying 
the  refreshments? 

6.  What  is  the  total  number  of  students   6.   25. 
on  the  fall  dance  committee? 

7.  How  much  time  would  the  committee  as   7.   275  hours, 
a  whole  spend  in  preparation  for  the 
dance? 

8.  How  much  time  would  the  average  com-   8.   11  hours, 
mittee  member  contribute? 

9.  How  many  boys  on  the  committee  are     9.   6  boys, 
involved  in  the  sale  of  tickets? 

10.   How  many  girls  are  on  the  refresh-    10.   10  girls, 
ment  part  of  the  dance  committee? 


240  boys  attend  Spencer  High. 
10. 

Yes. 

14. 


Solution:   5  girls, 
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Problem  31  B 

Instructions  and  Corresponding  Questions  and  Answers 

We  have  a  certain  number  of  objects ,  M,  a  part  of  which,  for  lack  of  a 
better  name,  will  be  called  C's.  The  C's  are  composed  of  B's  and  G's.   No 
B  is  a  G  and  vice  versa.   Some  of  the  C's  also  are  R' s  and  some  others  are 
T's.   No  R  is  a  T  and  vice  versa.  How  many  G's  are  also  T's? 

Questions 

1.  Are  there  C's  that  are  not  B's  and 
G's? 

2.  How  many  B's  are  C's? 

3.  How  many  B's  are  M' s? 
A.  How  many  C's  are  R' s? 

5 .  Are  there  more  G  * s  than  B ' s  among 
the  M's? 

6.  What  is  the  value  of  k  times  the 
C's? 

7.  What  is  the  total  number  of  C's? 

8.  How  many  B's  that  are  C's  are  also 
T's? 

9.  How  many  G's  that  are  C's  are  also 
R's? 

10.   What  is  the  value  of  k? 


Ans 

wers 

1. 

No. 

2. 

30. 

3. 

120. 

A. 

35. 

5. 

Yes. 

6. 

550. 

7. 

50. 

8. 

10. 

9. 

15. 

10. 

11. 

Solution:   5  G's, 
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19. 
Problem  31  C 

Instructions  and  Corresponding  Questions  and  Answers 

Assume  that  X,  A,  D,  P,  and  S,  represent  properties  among  F  objects. 
Not-Xj  not-A,  and  so  on  represent  lack  of  these  properties.   Out  of  F  objects 
some  of  them  are  X's  and  some  not-X's.  The  not-X's  are  formed  by  not-A's 
and  not-D's.  A  not-A  can  not  be  a  not-D  and  vice  versa. 

Some  of  the  not-X's  also  are  not-P's  and  some  others  are  not-S's.  A 
not-P  can  not  be  a  not-S  and  vice  versa. 

How  many  not-D's  are  also  not-S's? 

Questions  Answers 

1.  Are  there  not-X's  that  are  A's  and        1.   No. 
D's? 

2.  How  many  not-A's  are  F's? 

3.  Are   there  more  not-D's  than  not-A's 
among   the  F's? 

4.  How  many  not-A's   are  not-X's? 

5.  What  is  the  total  number  of  not-X's? 

6.  How  many  not-X's  are  not-P's? 

7.  What   is   the  value  of   1    times   the 
not-X's? 

8.  What   is   the  value  of   1? 

9.  How  many  not-D's   that   are  not-X's 
are   also  not-P's? 

10.     How  many  not-A's  that   are  not-Xfs  10.      10. 

are  also  not-S's? 


2. 

100 

3. 

Yes 

4. 

14. 

5. 

40. 

0. 

24. 

7  . 

440 

8. 

11. 

o 

20. 

Solution:      6  not-D's, 
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Problem  51  D 


Instructions  and  Corresponding  Questions  and  Answers 

From  R  objects  L  have  been  selected.  These  objects  are  formed  by  A  and 
B  objects.  No  A  can  also  be  a  B  and  vice  versa.   Some  of  the  L  objects  are 
also  M  and  some  others  N.   No  M  can  also  be  an  N  and  vice  versa. 


How  many  N's  are  also  B's? 


9. 
10. 


Questions 

How  many  A's  are  R'  s? 

What  is  the  total  number  of  L's? 

How  many  L's  are  M's? 

How  many  A ' s  are  L's? 

Are  there  more  B's  than  A's  among 

the  R's? 

Are   there  L's   that   are  not  B's  and 

A's? 

How  many  B's  that  are  L  are  also  M? 

How  man}'  A's  that  are  L  are  also  N? 

What  is  the  value  of  k? 

What  is  the  value  of  k  times  the  L's? 


Answers 

1. 

W. 

2. 

E+F+H+I    =  X+Y  ■■ 

=  P+Q 

5. 

E+F   =  X 

4. 

E+H   =  P 

5. 

Yes. 

6. 

No. 

7. 

F. 

8. 

H. 

o  m 

T. 

0. 

Z. 

Solution: 
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21. 
Problem  33  A 

Instructions  and  Corresponding  Questions  and  Answers 

A  drug-store  owner  receives  different  types  of  magazines  that  have 
different  prices.   Some  cost  less  than  25$ ,    some  cost  more  than  25$,      You 
are  to  find  out  how  many  mystery  magazines  cost  more  than  25$ .   Read  all  the 
questions  carefully. 

Questions  Answers 

1.  What  kinds  of  magazines  does  the         1.   Mystery,  sports  and  mechani- 
store  receive?  cal  magazines. 

2.  Has  the  store  more  magazines  about       2.   No. 
mechanics  than  sports? 

3.  Has  the  store  more  magazines  about       3.   Yes. 
mechanics  than  mystery  magazines? 

4.  How  many  different  prices  do  the         4.   3. 
magazines  have? 

5.  What  is  the  total  number  of  magazines    5.   60. 
which  the  store  receives? 

6.  How  many  magazines  cost  25$   or  more?     6.   52. 

7.  How  many  mechanics  magazines  cost        7.   5. 
less  than  25£? 

8.  Do  all  the  sports  magazines  cost  less    8.   No 
than  25$? 

9.  How  many  sports  magazines  and  mecha-     9.   6. 
nics  magazines  cost  less  than  25$? 

10.  Do  all  the  mystery  magazines  cost       10.   No. 
less  than  25$? 

11.  How  many  sports  magazines  are  11.   30. 
received? 

12.  How  many  mechanics  magazines  are        12.   20. 
received? 

13.  How  many  mystery  magazines  are         13.   10. 
received? 


Solution:   8  mystery  magazines. 
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22. 
Problem  33  B 

Instructions  and  Corresponding  Questions  and  Answers 

A  number  of  objects  have  been  collected  into  one  general  classification 
and  are  called  T's.   There  are,  however,  various  types  of  T's.   Each  of  these 
types  are  further  subdivided  into  E's  and  F's.   Your  task  is  to  determine 
how  many  objects  of  S  type  are  also  F's. 

Questions 

1.  How  many  types  of  objects  are  there? 

2.  Are   there  more  A's   than  S*s? 

3.  Are   there  more  P's   than  A's? 

4.  How  many  objects  are  F's? 

5.  What  is  the  total  number  of  objects? 

6.  How  many  properties  can  each  type 
have? 

7.  How  many  P's  and  A's  are  E's? 

8.  How  many  P's  are  also  E's? 

9.  How  many  A's  are  also  E's? 

10.  How  many  P's  are  there? 

11.  How  many  S's  are  there? 

12.  Are  all  S's  also  F's? 

13.  How  many  A's  are  there? 


An 

swers 

1. 

S,  A, 

and 

2. 

Yes. 

3. 

Yes. 

4. 

33. 

5. 

45. 

6. 

F   and 

E. 

7. 

8. 

8. 

3. 

9. 

.5. 

10. 

20. 

11. 

10. 

12. 

No. 

13. 

15. 

Solution:   6  objects  of  S  type  are  also  F's, 
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23. 
Problem  33  G 

Instructions  and  Corresponding  Questions  and  Answers 

Objects  according  to  their  properties  have  been  classified  G's  and 
not-G's.   The  not -G's  are  composed  of  different  types.   Each  of  these  types 
may  be  either  not-P's  or  not-Q's.   Your  task  is  to  discover  how  many  not-A's 
are  also  not-Q's. 

Questions  Answers 

1.  How  many  types  of  objects  are  there?  1.  Not-A's,  not-B's,  not-C's. 

2.  What  is  the  total  number  of  objects?  2.  30. 

3.  How  many  properties  can  each  type  3.  Not-P  and  not-Q. 
have? 

4.  Are  there  more  not-B's  than  not-A's?  4.  Yes. 

5.  Are  there  more  not-C's  than  not-B's?  5.  Yes. 

6.  How  many  not-B's  and  not-C's  are  also  6.  4. 
not-P's? 

7.  How  many  not-C's  are  also  not-P's?  7.  1. 

8.  How  many  not-B's  are  also  not-P's?  8.  3. 

9.  How  many  objects  are  not-Q's? 

10.  Row  many  not-A's  are  there? 

11.  How  many  not-C's  are  there? 

12.  How  many  not-B's  are  there? 

13.  Are  all  not-A's  also  not-Q's? 


>.  m 

25. 

10. 

5. 

11. 

15. 

12. 

10. 

13. 

No. 

Solution:   4  not-A's  are  also  not-Q's. 
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24. 
Problem  33  D 


Instructions  and  Corresponding  Questions  and  Answers 

A  number  of  objects  have  been  collected  into  one  general  classification 
and  are  called  W*s.  There  are  various  types  of  W*s.  Each  of  these  types  is 
further  subdivided  into  D' s  and  E's.   Your  task  is  to  determine  how  many 
objects  of  A  type  are  also  E's. 

Questions 

1.  How  many  types  of  objects  are  there? 

2.  Are  there  more  C's  than  B's? 

3.  Are  there  more  B's  than  A' s? 

4.  How  many  properties  can  each  type  have? 

5.  What  is  the  total  number  of  objects? 

6.  How  many  objects  are  E's? 

7.  How  many  B's  are  also  E's? 

8.  How  many  C's  are  also  E's? 

9.  How  many  C's  and  B's  are  D* s? 

10.  Are  all  A*s  also  E's? 

11.  How  many  B's  are  there? 

12.  How  many  C's  are  there? 

13.  How  many  A's  are  there? 


Answers 

1. 

A,   B,   C. 

2. 

Yes. 

3. 

Yes. 

4. 

D  and  E. 

5. 

R  +  S   +  T 

P   +  Q. 

6. 

N   +  L    +  Q 

7. 

L. 

8. 

Q. 

9. 

P    +  K. 

10. 

No. 

11. 

S    =  K   +  L. 

12. 

T   =  P    +  Q. 

13. 

R  =  M  +  N. 

M  +  N  +  K+L  + 


=  E. 


Solution:   N  objects  of  A  type  are  also  E's, 
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25. 
Problem  35  A 

Instructions  and  Corresponding  Questions  and  Answers 

A  college  choral  group  is  composed  of  freshmen,  sophomores  and  juniors. 
The  chorus  has  three  voices  or  parts  which  are  high,  medium,  and  low.   The 
questions  and  answers  below  give  vital  information  concerning  the  group. 
From  these  facts  you  are  to  find  the  number  of  juniors  singing  the  middle  or 
medium  part. 

Questions 

1.  How  many  juniors  are  in  this  college? 

2.  How  many  freshmen  are  in  the  chorus? 

3.  How  many  sophomores  are  in  the  middle 
voice? 

4.  How  many  chorus  members  are  there? 

5.  How  many  girls  are  in  the  chorus? 

6.  How  many  sophomores  are  in  the  chorus? 

7.  How  many  juniors  sing  the  high  voice? 

8.  How  many  freshmen  are  in  this  college? 

9.  How  many  freshmen  sing  the  high  voice? 

10.  How  many  low  voice  members  are  there? 

11.  How  many  sophomores  sing  the  high  part? 

12.  How  many  pianos  does  the  chorus  have? 

13.  How  many  freshmen  sing  the  low  voice? 

14.  How  many  chorus  members  sing  the  high 
voice? 

15.  How  many  juniors  are  in  the  low  voice      15.   10 
section? 

16.  How  many  freshmen  sing  the  middle         16.   6. 
voice? 

17.  How  many  sophomores  sing  the  low  part?     17.   9. 


Answers 

1. 

1567. 

2. 

23. 

3. 

10. 

4. 

76. 

5. 

45. 

6. 

28. 

7. 

7. 

3. 

1848 

9. 

8. 

10. 

28. 

11. 

9. 

12. 

5 

13. 

9. 

14. 

24. 

Solution:   8  juniors. 
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26. 
Problem  35  B 

Instructions  and  Corresponding  Questions  and  Answers 

T  objects  are  composed  of  M,  N,  and  P  types.  Each  of  these  latter  three 
typ^s  nay  or  may  not  also  be  Q's,  R* s  and  S's.   From  the  questions  and  answer: 
you  can  discover  the  various  relationships  of  these  objects.   Make  use  of 
this  available  information  to  determine  how  many  T  objects  are  N's  and  also 
S's. 


Questions 

1.  How  many  S's  are  A's? 

2.  How  many  Q's  are  there  among  the  T's? 
5.  How  many  G's  are  there  among  the  T's? 

4.  How  many  R' s  are  also  N's? 

5.  What  is  the  total  number  of  T  objects? 

6.  How  many  P's  are  there  among  the  T's? 

7.  How  many  R*s  are  there  among  the  T's? 

8.  How  many  Q's  arc  also  M's? 

9.  How  many  R*s  are  also  M's? 

10.  How  many  S*s  are  also  M's? 

11.  How  many  Q's  are  A's? 

12.  How  many  R's  are  also  P's? 

13.  How  :nany  Q's  are  also  N's? 

14.  How  .aany  S's  are  also  P's? 

15.  How  many  M's  are  among  the  T's? 

16.  How  many  Q*s  are  also  P's? 

17.  How  many  H' s  ancng  the  A's? 


Answer 

1. 

350. 

2. 

19. 

3. 

43. 

4. 

8. 

5. 

63. 

6. 

21. 

7. 

24. 

8. 

5. 

9. 

10. 

i0. 

2. 

11. 

400. 

12. 

6. 

13. 

3. 

14. 

k. 

15. 

17. 

16. 

11. 

17. 

2. 

Solution:   14  T  objects  arc  N's  and  also  S's, 
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27. 
Problem  35  C 

Instructions  and  Corresponding  Questions  and  Answers 

A  class  of  objects  is  distinguished  by  calling  some  B's  and  some  others 
not-B's  depending  on  the  possession  or  non-possession  of  a  certain  property. 
The  not-B's  are  further  distinguished  into  not-X's,  not-Y's,  and  not-Z's. 
Each  of  these  latter  may  also  be  a  not-D,  not-E,  or  not-F.   From  the  accom- 
panying questions  and  answers  you  can  discover  the  relationships  that  exist 
between  these  objects.   Make  use  of  the  information  available  to  determine 
how  many  not-B  objects  are  not-Y's  and  also  not-F*s. 

Questions 

1.  How  many  not-D* s  are  not-A's? 

2.  How  many  not-F' s  are  also  not-X's? 

3.  How  many  not-E's  are  there  among  the 
not-B's? 

4.  How  many  not-G's  are  there  among  the 
not-B's? 

5.  What  is  the  total  number  of  not-B's? 

6.  How  many  not-E's  are  also  not-Y's? 

7.  How  many  not-D* s  are  there  among  the 
not-B's? 

8.  How  many  not-F' s  are  not-A's? 

9.  How  many  not-E's  are  also  not-Z's? 

10.  How  many  not-D* s  are  also  not-Y's? 

11.  How  many  not-F' s  are  also  not-Z's? 

12.  How  many  not-X's  are  there  among  the 
not-B's? 

13.  How  many  not-D's  are  also  not-Z's? 

14.  How  many  not-H's  are  there  among  the    14.   2  log  cos  30c 
not -A*  s? 

15.  How  many  not-E's  are  also  not-X's? 

16.  How  many  not-Z's  are  there  among  the 
not-B's? 

17.  How  many  not-D's  are  also  not-X's?      17 


Answers 

1. 

150. 

2. 

7. 

3. 

15. 

4. 

50. 

5. 

45. 

6. 

6. 

7. 

6. 

8. 

100. 

9. 

5. 

10. 

2. 

11. 

9. 

12. 

12. 

13. 

3. 

14. 

2   log  cos 

15. 

4. 

16. 

17. 

Solution:   8  not-B  objects  are  not-Y's  and  also  not-F' s. 
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Problem  35  D 


Instructions  and  Corresponding  Questions  and  Answers 

A  group  of  L  objects  taken  from  a  larger  group  of  M  objects  is  composed 
of  objects  of  the  kind  A,  B  and  C.   If  an  object  is  an  A,  it  can  not  be  a  B 
or  C.   If  an  object  is  a  B,  it  can  not  be  an  A  and/or  C.   If  an  object  is  a 
Cj  it  can  not  be  a  B  and/or  A.   That  is,  A,  B,  and  C  are  mutually  exclusive. 
The  same  L  objects  also  have  properties  D,  E  and  F  which  are  mutually  ex- 
clusive. 

From  the  questions  below  you  are  to  find  how  many  of  the  B's  are  also 
F's. 


Questions 


Answers 


How  many  F's  are  in  J? 
How  many  L's  are  D's? 
What  is  the  number  of  L's? 


A. 

How 

many 

E 

1  s 

are 

B' 

s? 

5. 

How 

many 

L 

1  s 

are 

K' 

s? 

6. 

How 

many 

D 

1  s 

are 

in  M 

7. 

How 

many 

L 

s 

are 

E' 

s? 

8. 

How 

many 

F 

s 

are 

A1 

s? 

9. 

How 

many 

E 

s 

are 

A' 

s? 

10. 

How 

many 

D 

s 

are 

A' 

3? 

11. 

How 

many 

L 

1  s 

are 

C 

s? 

12. 

How 

many 

F 

s 

are 

c 

s? 

13. 

How 

many 

L 

s 

arc 

A 

s? 

14. 

How 

many 

D 

s 

are 

C 

s? 

15. 

How 

many 

U 

s 

are 

M1 

s? 

16. 

How 

many 

D 

s 

are 

Bs 

s? 

17. 

How 

many 

E 

's 

are 

C 

s? 

1. 

U. 

2. 

M  + 

N  +  0  =  X. 

3. 

M+N+0+R+Q+P+S+T+V  =  X+Y+Z 

G+H 

••I  =  L. 

4. 

Q. 

5. 

W. 

6. 

X  - 

M  +  0. 

7. 

R  + 

Q  +  P  =  Y 

8. 

S. 

9. 

R. 

10. 

M. 

11. 

0  + 

P  +  V  =  I. 

12. 

V. 

13. 

M  + 

R  +  S  =  G. 

14. 

0. 

15. 

u  - 

J. 

16. 

N. 

17. 

P. 

Solution:   T  of  the  B's  are  also  F's, 
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29. 
Problem  37  A 


Instructions  and  Corresponding  Questions  and  Answers 

At  a  branch  office  of  the  Kraft  Cheese  Co.  in  Peoria,  Illinois,  a  certain 
number  of  employees  are  eligible  for  promotion.  Only  a  certain  limited  amount 
of  information  is  available  to  the  personnel  manager  concerning  these  people. 
Part  of  this  information  is  the  number  of  employees  who  have  attained  various 
levels  of  education.   These  levels  of  education  are  distributed  among  various 
jobs.  As  the  assistant  to  the  personnel  manager  you  are  to  determine  how  many 
administrative  employees  are  eligible  for  promotion. 


20. 

1) 

2) 
3) 
83. 


Questions 

1.  How  many  employees  are  eligible  for      1. 
promotion? 

2.  How  many  levels  of  education  are  re-      2. 
presented  among  the  employees  eligible 
for  promotion? 

3.  How  many  persons  does  the  Kraft  branch    3. 
office  employ? 

4.  How  many  employees  eligible  for  pro-      4. 
motion  have  attained  only  a  high  school 
education? 

5.  What  is  the  kind  of  work  which  those      5. 
who  have  received  only  an  elementary 
education  do? 

6.  How  many  employees  eligible  for  pro-      6. 
motion  have  received  a  college  education? 

7.  What  kind  of  work  do  the  employees  hav-   7. 
ing  only  a  high  school  education  do? 

8.  How  many  employees  eligible  for  pro-      8.  8. 
motion  have  received  only  an  elementary 
education? 

9.  Have  all  the  people  in  administrative     9.  No. 
work  eligible  for  promotion  received 

only  a  high  school  education? 

10.  What  kind  of  work  do  the  people  who      10. 
have  a  college  education  do? 

11.  Are  all  the  eligible  employees  with      11. 
only  a  high  school  education  doing  ad- 
ministrative work? 

12.  How  many  eligible  employees  with  only    12# 
an  elementary  education  work  on  the 
loading  docks? 


Answers 


elementary  education 
high  school  education 
college  education 


Some  are  employed  on  the 
loading  docks  while  the 
others  do  clerical  work. 
5. 

Administrative  work. 


The  do  administrative  work 
and  are  on  the  board  of 
directors. 
Yes. 
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Problem  37  A 
(Continued) 


Questions  Answers 

13.  How  many  eligible  employees  with  a       13.   3. 
college  education  are  on  the  board 

of  directors? 

14.  How  many  eligible  employees  with  only    14.   5. 
an  elementary  education  do  clerical 

work? 


Solution:   9  administrative  employees 
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Problem  37  B 


Instructions  and  Corresponding  Questions  and  Answers 

We  are  interested  in  a  group  of  objects  which  will  be  denoted  by  the 
Greek  letter  Z.  This  group  is  composed  of  different  varieties  each  of  which 
will  be  denoted  by  a  capital  letter.  These  varieties  may  also  be  subdivided 
and  these  last  subdivisions  will  be  identified  by  small  letters.  Your  task, 
then,  is  to  discover  how  many  objects  from  the  original  group  (called  Z)  are 
also  d*s. 


Questions 


1.  The  group  Z  was  selected  from  how 
many  objects? 

2.  How  many  objects  belong  to  the  group 
denoted  by  Z? 

3.  How  many  varieties  of  Z  are  there? 

4.  How  many  objects  of  G  variety  are  there?  4.   3. 

5.  How  many  objects  of  A  variety  are  there?  5.   4. 


Answers 

1.  65. 

2.  12. 

3.  Three.   1)  A,  2)  B,  3)  C. 


6.  How  is  B  subdivided? 

7.  Are  all  the  objects  that  are  "d"  also 
of  A  variety? 

8.  How  is  A  subdivided? 

9.  How  many  objects  belong  to  B  variety? 

10.  How  many  objects  of  B  variety  are 
"f's"? 

11.  How  many  objects  of  B  variety  are 
"g's"? 

12.  How  is  G  subdivided? 

13.  How  many  objects  of  C  variety  are 
"e's"? 

14.  Are  all  the  objects  of  A  variety 
"d's"? 


6.  Subdivided  into  "g"  and  "f" 
types. 

7.  No. 

8.  It  is  divided  in  objects  of 
"d"  type. 

9.  5. 

10.  3. 

11.  2. 

12.  into  "d"  and  "e"  types. 

13.  2. 

14.  Yes. 


Solution:   5  objects  from  the  original  group  (called  Z)  are  also  d*: 
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52. 


Instructions  for  Problem  32  A 


Each  of  the  areas  in  the  accompanying  figure  are  identified  by  means  of 
the  numbers  found  printed  in  them.  These  numbers  are  merely  for  the  purposes 
of  indicating  the  particular  area  being  discussed  and  have  no  bearing  on  the 
solution  of  the  oroblem  whatsoever. 

The  problem  then  is  this.   Each  area  has  been  assigned  a  letter  accord- 
ing to  a  predetermined  plan.   Your  task  will  be  to  discover  the  letters 
belonging  to  the  areas  which  have  their  identifying  numbers  circled.  This 
may  be  accomplished  by  asking  the  letter  for  any  area  other  than  the  ones 
circled.   Decide  which  area  you  would  like  to  know  first.   Then  ask  for  its 
letter.   Continue  working  in  this  fashion  until  you  feel  you  have  sufficient 
information  to  specify  accurately  the  letters  for  the  areas  with  the  circled 
numbers. 


Note:   The  rationale  underlying  the  assignment  of  letters  to  the  various 
areas  is  as  follows:   beginning  with  the  area  identified  by  the 
number  "5"  and  proceeding  from  left  to  right  by  succersive  rowSj 
each  area  was  assigned  its  corresponding  letter  in  the  series 
x,  y,  z;  a}   b}    c  in  that  order  of  occurrence,  repeating  the  series 
as  often  ao  is  necessary  to  assign  £  value  to  each  area. 


Solution:   11  =  y,  4  =  a. 
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Problem  32A 


i 

Key 
/ 

1    /    "1 

X 

viz 

•a/       b 

! 

\-i--\ 

i 

c 

x      I       y_ 

_     _    \_     _ 

,    z     j         a 

b 

c           1       X 
1 

r  y      i     z 

a 

>        |    c 
1 

:.  U| 

1           ! 
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Instructions  for  Problem  32  B 


Each  of  the  areas  in  the  accompanying  figure  are  identified  by  means  of 
the  capital  or  upper  case  letters  found  printed  in  them.  These  letters  are 
merely  for  the  purposes  of  indicating  the  particular  area  being  discussed  and 
have  no  bearing  on  the  solution  of  the  problem  whatsoever. 

The  problem  then  is  this.  Each  area  has  been  assigned  a  symbol  other  than 
the  above  identifying  capital  letters  according  to  a  predetermined  plan.  Your 
task  will  be  to  discover  the  symbols  belonging  to  the  areas  which  have  their 
identifying  capital  letters  circled.   This  may  be  accomplished  by  asking  the 
symbol  for  any  area  other  than  the  ones  circled.   Decide  which  area  you  would 
like  to  know  first.  Then  ask  for  its  symbol.   Continue  working  in  this  fashior. 
until  you  feel  you  have  sufficient  information  to  specify  accurately  the 
symbols  for  the  areas  with  the  circled  letters. 


Note:   The  rationale  underlying  the  assignment  of  symbols  to  the  various 
areas  is  as  follows:   beginning  with  the  area  identified  by  the 
upper  case  letter  I  and  proceeding  from  left  to  right  by  successive 
rows,  symbols  were  assigned  the  various  areas  according  to  their 
corresponding  position  in  a  sequence  formed  by  alternating  series 
of  first  three  lower  case  letters  and  then  three  numbers.   The 
first  letter  in  the  series  was  "a",  the  next  "b" 3   and  so  on  alpha- 
betically.  The  numbers  began  with  "1"  and  progressed  in  the  normal 
order  of  the  positive  integers.  Thus  a  sequence  of  letters  and 
numbers  was  constructed  sufficient  to  assign  a  symbol  to  each  area. 


Solution:   Q  =  f,   E  =  8. 
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36. 


Instructions  for  Problem  32  C 


Each  of  the  areas  in  the  accompanying  figure  are  identified  by  means  of 
the  small  or  lower  case  letters  found  printed  in  them.   These  letters  are 
merely  for  the  purposes  of  indicating  the  particular  area  being  discussed  and 
have  no  bearing  on  the  solution  of  the  problem  whatsoever. 

The  problem  then  is  this.   Each  area  has  been  assigned  a  number  according 
to  a  predetermined  plan.   Your  task  will  be  to  discover  the  numbers  belonging 
to  the  areas  which  have  their  identifying  letters  circled.   This  may  be 
accomplished  by  asking  the  number  for  any  area  other  than  the  ones  circled. 
Decide  which  area  you  would  like  to  know  first.  Then  ask  for  its  number. 
Continue  working  in  this  fashion  until  you  feel  you  have  sufficient  information 
to  specify  accurately  the  numbers  for  the  areas  with  the  circled  letters. 


Note:   The  rationale  underlying  the  assignment  of  numbers  to  the  various 
areas  is  as  follows:   beginning  with  area  "p"  and  proceeding  from 
left  to  right  by  successive  rows,  numbers  were  assigned  the  various 
areas  according  to  their  corresponding  position  in  a  sequence  formed 
by  alternating  series  of  first  three  positive  and  then  three  negative 
numbers.  The  first  positive  series  is  1,  2,    3  and  the  next  is  2,  3, 
A,  i.e.,  the  initial  number  of  a  series  is  the  second  number  of  the 
preceeding  scries  of  the  same  type.   The  negative  series  were  simi- 
larly determined  so  that  the  first  is  ~5}    -6,   -7 }    and  the  second  is 
-5.  -7.  -8. 


Solution:   i  =  3,  h  = 
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Problem  32C 


(v j j 


m  i         t 


h     i 
J       \ 


Key 

1 



-7 

2 

2 
-8 

/       3         1-5 

'-  -  -J 

1 

\ 

13         '4 

i 

1   _       ' 

!  J 

-6 
\        *     i 

1 

-7 

1               j       i 

-8             -9      i      4        |       5     j 

38. 


Instructions  for  Problem  32  D 


Each  of  the  areas  in  the  accompanying  figure  are  identified  by  means  of 
the  capital  or  upper  case  letters  found  printed  in  them.   These  letters  are 
merely  for  the  purposes  of  indicating  the  particular  area  being  discussed  and 
have  no  bearing  on  the  solution  of  the  problem  whatsoever. 

The  problem  then  is  this.   Each  area  has  been  assigned  a  number  according 
to  a  predetermined  plan.   Your  task  will  be  to  discover  the  numbers  belonging 
to  the  areas  which  have  their  identifying  capital  letters  circled.  This  may 
be  accomplished  by  asking  the  number  for  any  area  other  than  the  ones  circled. 
Decide  which  area  you  would  like  to  know  first.  Then  ask  for  its  number. 
Continue  working  in  this  fashion  until  you  feel  you  have  sufficient  information 
to  specify  accurately  the  numbers  for  the  areas  with  the  circled  letters. 


Note:   The  rationale  underlying  the  assignment  of  numbers  to  the  various 
areas  is  as  follows:   beginning  with  area  "P"  and  proceeding  from 
left  to  right  by  successive  rows,  numbers  were  assigned  the  areas 
according  to  their  corresponding  position  in  a  predetermined  sequence. 
The  sequence  was  constructed  in  this  manner:   one  was  defined  to  be 
the  first  number;   the  remaining  numbers  were  determined  by  perform- 
ing the  following  indicated  operations  with  the  value  of  the  previous 
area:   +2,  +3^  -1,  +3,  +4,  -1,  +2 }   +3,  ...  It  is  seen  that  every 
two  addition  operations  are  separated  by  the  subtraction  of  one  with 
the  two  sets  alternating. 


Solution:   T  =  16,  F  =  28. 
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Problem  32D 
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Instructions  for  Problem  34  A 


Each  of  the  areas  in  the  accompanying  figure  are  identified  by  means  of 

the  numbers  found  printed  in  them.   These  numbers  are  merely  for  the  purooses 

of  indicating  the  particular  area  being  discussed  and  have  no  bearing  on  the 
solution  of  the  problem  whatsoever. 

The  problem  then  is  this.   Each  area  has  been  assigned  a  letter  according 
to  a  predetermined  plan.   Your  task  will  be  to  discover  the  letters  belonging 
to  the  areas  which  have  their  identifying  numbers  circled.  This  may  be 
accomplished  by  asking  the  letter  for  any  area  other  than  the  ones  circled. 
Decide  which  area  you  would  like  to  know  first.   Then  ask  for  its  letter. 
Continue  working  in  this  fashion  until  you  feci  you  have  sufficient  information 
to  specify  accurately  the  letters  for  the  areas  with  the  circled  numbers. 


Note:  The  rationale  underlying  the  assignment  of  letters  to  the  various 
areas  is  as  follows:   all  areas  whose  right  borders  were  red  were 
assigned  the  letter  "a",   all  others  were  assigned  the  letter  "b". 


Solution:   31  =  b ,   25  =  b. 
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Instructions  for  Problem  34  B 


Each  of  the  areas  in  the  accompanying  figure  are  identified  by  means  of 
the  capital  or  upper  case  letters  found  printed  in  them.  These  letters  are 
merely  for  the  purposes  of  indicating  the  particular  area  being  discussed  and 
have  no  bearing  on  the  solution  of  the  problem  whatsoever. 

The  problem  then  is  this.   Each  area  has  been  assigned  a  symbol  other  than 
the  above  identifying  capital  letters  according  to  a  predetermined  plan.   Your 
task  will  be  to  discover  the  symbols  belonging  to  the  areas  which  have  their 
identifying  capital  letters  circled.   This  may  be  accomplished  by  asking  the 
symbol  for  any  area  other  than  the  ones  circled.   Decide  which  area  you  would 
like  to  know  first.  Then  ask  for  its  symbol.   Continue  working  in  this  fash- 
ion until  you  feel  you  have  sufficient  information  to  specify  accurately  the 
symbols  for  the  areas  with  the  circled  letters. 


Note:   The  rationale  underlying  the  assignment  of  symbols  to  the  various 

areas  is  as  follows:   those  areas  whose  left  borders  were  r^d  received 
numerical  symbols  and  all  others  received  lower  case  letter  symbols. 
Beginning  with  area  "R"  and  proceeding  from  left  to  right  by  successive 
rows,  lower-case  letters  were  assigned  the  pertinent  ar^as  alphabeti- 
cally from  "a"  through  "x".  According  to  the  same  procedure,  nuubers 
were  assigned  the  areas  with  the  left  red  border,  with  ar-^a  "DD"  re- 
ceiving the  number  "2"  and  each  successive  area  receiving  a  value  of 
twice  the  value  of  the  previously  assigned  number. 


Solution:   M  =  g,   X  -  2043. 
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Instructions  for  Problem  34  C 


Each  of  the  areas  in  the  accompanying  figure  are  identified  by  means  of 
the  small  or  lower  case  letters  found  printed  in  them.   These  letters  are  mere- 
ly for  the  purposes  of  indicating  the  particular  area  being  discussed  and  have 
no  bearing  on  the  solution  of  the  problem  whatsoever. 

The  problem  then  is  this.   Each  area  has  been  assigned  a  number  according 
to  a  predetermined  plan.   Your  task  will  be  to  discover  the  numbers  belonging 
to  the  areas  which  have  their  identifying  letters  circled.  This  may  be  accom- 
plished by  asking  the  number  for  any  area  other  than  the  ones  circled.   Decide 
which  area  you  would  like  to  know  first.  Then  ask  for  its  number.   Continue 
working  in  this  fashion  until  you  feel  you  have  sufficient  information  to 
specify  accurately  the  numbers  for  the  areas  with  the  circled  letters. 


Note:   The  rationale  underlying  the  assigmr^nt  of  numbers  to  the  various 

areas  is  as  follows:   area  "s"  was  assigned  the  value  "1".   Then  by 
proceeding  horizontally  to  the  right  the  next  area  was  assigned  a 
value  of  "5"  plus  the  value  of  the  preceeding  area  if  the  color  of  the 
line  separating  the  two  areas  was  red;   if  blue,  the  value  of  any  area 
was  one  less  the  value  of  the  preceeding  area.   When  proceeding  down- 
ward through  any  column,  one  would  observe  the  value  of  any  area  to  be 
"5"  plus  the  value  of  the  area  immediately  above  it. 


Solution:   e  =  7,   k  -   34. 
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Problem  34C 
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Instructions  for  Problem  34  D 


Each  of  the  areas  in  the  accompanying  figure  are  identified  by  means  of 
the  capital  or  upper  case  letters  found  printed  in  them.  These  letters  are 
merely  for  the  purposes  of  indicating  the  particular  area  being  discussed  and 
have  no  bearing  on  the  solution  of  the  problem  whatsoever. 

The  problem  then  is  this.   Each  area  has  been  assigned  a  number  according 
to  a  predetermined  plan.  Your  task  will  be  to  discover  the  numbers  belonging 
to  the  areas  which  have  their  identifying  capital  letters  circled.   This  may 
be  accomplished  by  asking  the  number  for  any  area  other  than  the  ones  circled. 
Decide  which  area  you  would  like  to  know  first.  Then  ask  for  its  number. 
Continue  working  in  this  fashion  until  you  feel  you  have  sufficient  information 
to  specify  accurately  the  numbers  for  the  areas  with  the  circled  letters. 


Note:  The  rationale  underlying  the  assignment  of  numbers  to  the  various 

areas  is  as  follows:   Considering  the  areas  to  form  a  sequence  that 
starts  with  area  "K"  and  proceeds  from  left  to  right  by  successive 
rows,  one  observes  the  numbers  assigned  to  a  particular  area  to 
depend  en  the  color  of  the  line  separating  it  from  the  one  preceeding 
it.   If  the  line  is  red,  the  value  of  an  area  is  twice  the  value  of 
the  preceeding  area.   If  the  line  is  blue  the  value  of  any  area  is  one 
less  the  value  of  the  preceeding  area.  The  value  of  area  "K"  is  given 

or,   1111! 


Solution:   B  =  14,  W  =  345. 
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Instructions  for  Problems  36  A,  B,  C,  D. 

Each  of  the  areas  in  the  accompanying  figure  are  identified  by  means  of 
the  numbers  found  printed  in  them.   These  numbers  are  merely  for  the  purposes 
of  indicating  the  particular  area  being  discussed  and  have  no  bearing  on  the 
solution  of  the  problem  whatsoever. 

The  problem  then  is  this.   Each  area  has  been  assigned  a  symbol  other  than 
the  above  identifying  numbers  according  to  a  predetermined  plan.   Your  task 
will  be  to  discover  the  symbols  belonging  to  the  areas  which  have  their 
identifying  numbers  circled.   This  may  be  accomplished  by  asking  the  symbols 
for  any  area  other  than  the  ones  circled.   Decide  which  area  you  would  like 
to  know  first.   Then  ask  for  its  symbol.   Continue  working  in  this  fashion 
until  you  feel  you  have  sufficient  information  to  specify  accurately  the  sym- 
bols for  the  arear,  with  the  circled  numbers. 


Note:   The  rationales  underlying  the  assignment  of  symbols  to  the  various 
areas  is  as  follows: 

Problem  36  A  -  The  value  of  a  particular  area  depends  upon  the  color 
of  the  borders  of  the  area.   The  value  of  each  border  of  an  area  were 
summed  to  get  the  value  of  the  area.   One  blue  border  has  a  value  cf 
"a"  and  one  red  border  has  a  value  of  "b".  Thus  the  value  of  area  "2" 
is  2a  +  2b. 

Problem  35  B  -  The  value  of  a  particular  area  depends  upon  the  type  of 
borders  of  each  area.   The  values  of  each  border  of  an  area  were  summed 
to  get  the  value  of  the  area.  A  straight  border  has  a  value  of  "a", 
a  dotted  border  has  a  value  of  "b",  and  a  curved  border  has  a  value  of 
"c".   Thus  the  value  of  area  "1"  is  a  +  B  +  2c. 

Problem  36  C  -  The  value  of  a  particular  area  depends  upon  the  color 
and  the  type  of  borders  of  the  area.  The  values  of  each  border  of  an 
area  were  summed  to  get  the  value  of  the  area.  A  blue  straight  border 
has  the  value  of  "a";   a  blue  dotted  border,  the  value  of  "b";   a  blue 
curved  border,  "c";   a  red  straight  border,  "d";  a  red  dotted  border, 
"e";  and  a  red  curved  border,  "f".  Thus  the  value  of  area  "17"  is 
a  +  b  +  c  +  f . 

Problem  36  D  -  The  value  of  a  particular  area  depends  upon  the  color 
and  the  type  of  borders  of  the  area.  The  values  of  each  border  of  an 
area  were  algebraically  summed  to  get  the  value  of  the  area.  Blue 
borders  have  the  same  values  as  in  Problem  36  C.  A  straight  red  border 
has  the  value  of  "-a";   a  dotted  red  border,  "-b";  and  a  curved  red 
border,  "-c".   Thus  the  value  of  area  "19"  isa+c-b  -c. 

Solutions:   Problem  36  A  -  2  =  2a  +  2b,   11  =  a  +  3b. 

Problem  36  B  -  1  =  a  +  b  +  2c,   17  =  3a  +  c. 
Problem  36  C  -6=a  +  b  +  c  +  f}   2=c+2d+e. 
Problem  36D-15=a+b+c-c,   8  =  c  -  2a  -  b. 
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Problem  36B 
I 

I 


11 


18 


1   i 


14 


12 


;/ 

f-- 

20       ' 


16 


IS 


13 


J 

■'-■] 

7 

• 

17    ) 

1 
i 

! 

■ 

15 

10 

i 
i 

Key 

I         \        I        T       I 

!2a+2b    'a+b+2c   2a+b+c  |  3a+c   j 

'   __  _.  _  1.  __    |  Note:  lines  and  por- 
j  "~  ~ rj — -— -r— ~~~r  '  i     ""'|   tions  of  lines  with 

ja+b+2c   !  2b+2c  '  a+2b+c  j  2a+b+c!   dots  alon£  both  sides 
—  •   j1       j  appeared  in  red  in  the 


original 


a+b+2c       >"  2b+2c        a+2b+< 


2a+2c       |    a+b+2c        2a+b+c    i 


j   3a+c       1.  2a+b+c     I     3a+b      j 


2a+b+cj 

3a+c 
4a 


Appendix   I 


51. 

Problem  36C 
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Instructions  for  Problem  38  A 


Each  of  the  areas  in  the  accompanying  figure  arc  identified  by  means  of 
the  numbers  found  printed  in  them.   These  numbers  are  merely  for  the  purposes 
of  indicating  the  particular  area  being  discussed  and  have  no  bearing  on  the 
solution  of  the  problem  whatsoever. 

The  problem  then  is  this.   Each  area  has  been  assigned  a  letter  according 
to  a  predetermined  plan.   Your  task  will  be  to  discover  the  letters  belonging 
to  the  areas  which  have  their  identifying  numbers  circled.  This  may  be 
accomplished  by  asking  the  letter  for  any  area  other  than  the  ones  circled. 
Decide  which  area  you  would  like  to  know  first.  Then  ask  for  its  letter. 
Continue  working  in  this  fashion  until  you  feel  you  have  sufficient  information 
to  specify  accurately  the  letters  for  the  areas  with  the  circled  numbers. 


Note:  The  rationale  underlying  the  assignment  of  letters  to  the  various  areas 
is  as  follows:   first,  it  is  to  be  observed  that  the  figure  is  divided 
into  four  quadrants  by  the  curved  lines.  All  of  the  areas  in  the  second 
and  third  quadrants  were  assigned  lower  case  letters  entirely  at  random, 
avoiding  reduplication.  Upper  case  letters  were  assigned  to  the  areas 
of  the  first  quadrant  on  the  basis  of  the  corresponding  position  of  the 
areas  of  the  third  quadrant  when  the  latter  quadrant  was  made  to  super- 
impose the  first  by  folding  the  whole  figure  at  the  principal  diagonal. 
The  upper  case  letters  for  the  various  areas  of  the  fourth  quadrant 
were  determined  in  the  same  manner,  except  the  figure  was  now  folded 
along  the  secondary  diagonal  of  the  whole  figure. 


Solution:   30  =  N,   19  =  M,   26  =  A. 
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Problem  38A 
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Instructions  for  Problem  38  B 


Each  of  the  areas  in  the  accompanying  figure  are  identified  by  means  of 
the  small  or  lower  case  letters  found  printed  in  them.   These  letters  are 
merely  for  the  purposes  of  indicating  the  particular  area  being  discussed  and 
have  no  bearing  on  the  solution  of  the  problem  whatsoever. 

The  problem  then  is  this.   Each  area  has  been  assigned  a  number  according 
to  a  predetermined  plan.   Your  task  will  be  to  discover  the  numbers  belonging 
to  the  areas  which  have  their  identifying  letters  circled.  This  may  be 
accomplished  by  asking  the  number  for  any  area  other  than  the  ones  circled. 
Decide  which  area  you  would  like  to  know  first.   Then  ask  for  its  number. 
Continue  working  in  this  fashion  until  you  feel  you  have  sufficient  information 
to  specify  accurately  the  numbers  for  the  areas  with  the  circled  letters. 


Note:  The  rationale  underlying  the  assignment  of  numbers  to  the  various  areas 
is  as  follows:   first,  it  is  to  be  observed  that  the  figure  is  divided 
into  four  quadrants  by  the  curved  lines.  All  of  the  areas  in  the 
second  and  third  quadrants  were  assigned  numbers  entirely  at  random, 
avoiding  reduplication.   The  first  quadrant  was  then  assigned  numbers 
ten  greater  than  the  number  found  in  the  corresponding  position  of  the 
third  quadrant  after  the  latter  quadrant  had  been  superimposed  on  the 
first  by  folding  along  the  principal  diagonal  of  the  whole  figure. 
The  numbers  for  the  various  areas  of  the  fourth  quadrant  were  deter- 
mined in  the  same  manner  except  the  whole  figure  was  now  folded  along 
the  secondary  diagonal. 


Solution:   f  =  25,  v  =  26,  y  -  12. 
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57. 
Problem  31  C* 

Instructions  and  Corresponding  Questions  and  Answers 

Assume  that  Z,   A,  B }   Q  and  R,  represent  properties  among  "y"  objects. 
Not-Z,  not-Aj  and  so  on  represent  lack  of  these  properties.   Of  "y"  objects 
some  are  Z's  and  some  are  not-Z's.   The  not-Z's  are  formed  by  not-A's  and 
not-B's.  A  not-A  can  not  be  a  not-B  and  vice  versa.  The  not-A's  and  not-B's 
may  also  be  not-Q* s  and  not-R's.  A  not-Q  can  not  be  a  not-R  and  vice  versa. 
How  many  not-A1 s  are  also  not-R's? 

Questions  Answers 

1.  Are  there  not-Z's  that  are  A's  and  Q's?  1.  No. 

2.  How  many  not-A's  are  Y' s?  2.  150. 

3.  Are  there  more  not-A's  than  not-B's  3.  Yes. 
among  the  Y's? 

4.  How  many  not-B's  are  not-Z's?  4.  12. 

5.  What  is  the  total  number  of  not-Z's?  5.  25. 

6.  How  many  not-Z*s  are  not-Q' s?  6.  11. 

7.  What  is  the  value  of  m  times  the  not-R's?  7.  450. 

8.  What  is  the  value  of  m?  8.3. 

9.  How  many  not-B's  that  are  not-Z's  are  S.  4. 
also  not-Q* s? 

10.   How  many  not-B's  that  are  not-Z's  are     10.   8. 
also  not-R's? 


Solution:   6  not-A's  are  also  not-R's, 
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58. 
Problem  35  A' 

Instructions  and  Corresponding  Questions  and  Answers 

The  athletic  director  at  St.  Lawrence  High  School  was  asked  by  the 
principal  of  the  school  to  report  on  the  academic  standing  of  the  fellows  in- 
volved in  the  sports  program.  Only  a  limited  amount  of  information  was 
available  to  the  director,  but  it  was  sufficient  to  provide  the  principal  with 
the  required  information. 

The  director  had  to  give  the  number  of  C  students  that  were  on  the  basket 
ball  team.  What  was  that  number?  Assume  that  no  player  is  a  member  of  more 
than  one  team. 

Questions 

1.  What  are  the  sports  in  which  St.  Lawrence  1.   Football,  basketball,  and 
High  School  participates? 

2.  Could  any  fellow  with  less  than  a  C 
average  be  in  the  sports  program? 

5.  How  many  C  students  are  there  in  this 
high  school? 

4.  How  many  A  students  are  there  in  the 
sports  program? 

5.  How  many  B  students  play  on  the  basket- 
ball team? 

6.  What  is  the  total  number  of  students  in 
the  sports  program? 

7.  How  many  sophomores  are  in  the  sports 
orogram? 

8.  How  many  B  students  are  in  the  sports 
program? 

9.  How  many  C  students  are  on  the  football 
team? 

10.  How  many  A  students  are  there  in  the 
school? 

11.  How  many  A  students  are  on  the  football   11.   5. 
taam? 

12.  How  many  men  are  on  the  track  team?       12.   23. 

13.  How  many  B  students  are  on  the  football   13.   12. 
team? 

14.  How  many  fellows  made  the  All-City  team   14.   6. 
in  their  respective  sport? 

15.  How  many  A  students  are  on  the  track      15.   6. 
team? 

16.  How  many  men  are  on  the  football  team?    16.   35. 

17.  How  many  C  students  are  on  the  track      17.   12. 
team? 


Answers 

1. 

Football, 

track. 

2. 

No. 

5. 

838. 

4. 

14. 

5. 

4. 

6. 

79. 

7. 

22. 

8. 

26. 

g 

IB. 

10. 

280. 
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Problem  35  A1 
(Continued) 


Questions  Answers 

18.  How  many  A  students  are  on  the  basket-    18.   3. 
ball  team? 

19.  How  many  B  students  are  on  the  track      19.   10. 
team? 


Solution:   9  C  students, 
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Instructions  for  Problem  32  E 


Each  of  the  areas  in  the  accompanying  figure  are  identified  by  means  of 
the  letters  found  printed  in  them.  These  letters  are  merely  for  the  purposes 
of  indicating  the  particular  area  being  discussed  and  have  no  bearing  on  the 
solution  of  the  problem  whatsoever. 

The  problem  then  is  this.   Each  araa  has  been  assigned  a  symbol  other 
than  the  above  identifying  letters  according  to  a  predetermined  Dlan.   Your 
task  will  be  to  discover  the  symbols  belonging  to  the  areas  which  have  their 
identifying  letters  circled.   This  may  be  accomplished  by  asking  the  symbols 
for  any  area  other  than  the  ones  circled.   Decide  which  area  you  would  like  to 
know  first.  Then  ask  for  its  symbol.   Continue  working  in  this  fashion  until 
you  feel  you  have  sufficient  information  to  specify  accurately  the  symbols  for 
the  areas  with  the  circled  letters. 


Note:   The  rationale  underlying  the  assignment  of  numbers  to  the  various 

areas  is  as  follows:   beginning  with  area  "f"  and  proceeding  from  left 
to  right  by  successive  rows,  numbers  were  assigned  the  areas  according 
to  their  relative  position  in  a  sequence  of  numbers  formed  by  an 
alternating  series  of  first  three  positive  and  then  three  negative  in 
the  order  of  increasing  absolute  magnitude.   Each  series  increases  in 
absolute  magnitude  independently  of  the  other,  though,  of  course, 
undergoing  interruption..   The  positive  series  begins  with  "2"   and  the 
negative,  with  a  "-3". 


Solution:   b  =  5, 
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Problem  32E 
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Instructions  for  Problem  36  E 


Each  of  the  areas  in  the  accompanying  figure  are  identified  by  means  of 
the  letters  found  printed  in  then.   These  letters  are  ;.erely  for  the  purposes 
of  indicating  the  particular  area  being  discussed  and  have  no  bearing  en  the 
solution  of  the  problem  whatsoever. 

The  problem  then  is  this.   Each  area  has  been  assigned  a  symbol  other 
than  the  above  identifying  letters  according  to  a  predetermined  plan.   Your 
task  will  be  to  discover  the  symbols  belonging  to  the  areas  which  have  th^ir 
identifying  letters  circled.   This  may  be  accomplished  by  asking  the  syiabols 
for  any  area  other  than  the  ones  circled.   Decide  which  area  you  would  like  to 
know  first.   Then  ask  for  its  symbol.   Continue  working  in  this  fashion  until 
you  feel  you  have  sufficient  information  to  specify  accurately  the  symbols  for 
the  areas  with  the  circled  letters. 


Note:   The  rationale  for  the  assignment  of  numbers  to  the  various  areas  is 
very  similar  to  Problem  36  D  and  is  as  follows:   the  value  for  a 
particular  area  depends  both  on  the  color  and  type  of  borders  of  the 
area.   The  values  of  each  border  of  an  area  were  algebraically  summed  to 
obtain  the  value  of  the  area.   Blue  borders  had  positive  values;   red 
borders,  negative.   A  straight  border  had  a  value  of  "4";  a  dotted 
border,  a  value  of  "3";  and  a  curved  border,  "2". 


Solution:   -m  =  4+3+2-2  =7,   f  =  2-4-4-3 
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1- 


Key 

4+4+2+2=. 4+3+2-2=,  4+4+3-2=   4+4+4+  j 
12      \        J       ,  9_J_ 2=14  j 

4+3+2-2=  ,3+3-2-2=,  4+3+3-     '    4+4+2-  j 
7        'j       J.  2=8  3=7    j 

'4+3+2-2=  '3+3+2-2=    3+3+2-    ,"  4+2-4- 
i  7        !  6  4=4  3=-l 


4+4+2-     i4+2-3-2=  ,2-4-4-     /  4+4+2 - 


1      2=8 


5=-9 


4=6 


J4+4+4-     '.'  4+4+3-     :  4+3-4-   'j,  4+4+4- 
j     2=10     '•       2=9  4=-l   •!,       4=8 


Note:  Lines  or  por- 
tions of  lines  with 
dots  along  both 
sides  appeared  in 
red  in  the  original. 
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Problem  31  D« 

Instructions  and  Corresponding  Questions  and  Answers 

From  "X"  objects  "Z"  have  been  selected.   These  objects  are  composed  of 
R  and  S  objects.   No  R  can  also  be  a  S  and  vice  versa.   Some  R's  are  also  E*s 
and  some  others  are  F's.  The  S's  can  also  be  E's  or  F's.   No  E  can  also  be 
an  F  and  vice  versa. 

How  many  F's  are  also  S's? 

Questions  Answers 

1.  How  many  R's  are  W's?  1 .  Y. 

2.  What  is  the  total  number  of  Z's?  2.  H  +  M  =  J  +  P  =  T. 

3.  How  many  Z's  are  E's?  3.  a  +  b  =  H. 

4.  How  many  R's  are  Z's?  4.  a  +  c  =  J. 

5.  Are  there  more  S's  than  R's  among  5.  Yes. 
the  "X's"? 

6.  Are  there  Z's  that  are  not  R's  or  S's?  6.  No. 

7.  How  many  S's  that  are  Z's  are  also  E's?  7.  b. 

8.  How  many  R's  that  are  Z's  are  also  F's?  8.  c. 

9.  What  is  the  value  of  k?  9.      r. 
10.   What  is  the  value  of  k  times  L?        10.  Q. 


Solution:   d  F's  are  also  S's. 
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Problem  35  B' 


Instructions  and  Corresponding  Questions  and  Answers 

"A"  objects  belong  either  to  X,  Y  or  Z  types.  Each  of  th^se  types  in 
turn  may  be  either  an  M}   an  U  or  an  0.  From  the  questions  and  answers  you 
may  discover  the  various  relationships  between  the  objects.   Mal:e  use  of  the 
available  information  to  determine  how  many  of  the  "A"  objects  are  both  Y  and 
0. 


1. 
2. 
3. 

4. 
5. 

6. 

7. 
0. 
9 

10. 

11. 
12. 
13. 
14. 
15. 
15. 
17. 


Questions 


How  many  S 
How  many  M 
How  many  G 
How  many  N 
What  is  the 
How  many  Z 
How  many  M 
How  many  N 
How  many  N 
How  many  M 
How  many  0 
How  many  N 
How  many  M 
How  many  0 
How  many  X 
How  many  M 
How  many  H 


s  ari 

s  are 

s  are 

's  are 

tota 

1  s  are 

are 

are 

are 

are 

are 

are 

are 

are 

s  are 

are 

arc 


T's?  1. 

there  among  the  A's?  2. 

there  among  the  A's?  3. 

also  Y's?  4. 
L  number  of  "A"  objects?   5. 

also  A's?  6 . 

also  X's?  7. 

also  A's?  8. 

alro  X's?  9. 

also  T's?  10. 

X's?  11. 

also  Z's?  12. 

also  Y's?  13. 

also  Z's?  14. 

there  among  the  A's?  15, 

also  Z's?  16. 

there  among  the  T's?  17. 


Answers 


200. 
22. 

None . 

5. 

72. 

31. 

4. 

23. 

7. 

300. 

6. 

11. 

10. 

12. 

17. 

8. 

2. 


Solution:   9  of  the  "A"  objects  are  both  Y  and  0. 
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Instructions  for  Problem  32  F 


Each  of  the  areas  in  the  accompanying  figure  are  identified  by  means  of 
the  letters  found  printed  in  them.   These  letters  are  merely  for  the  purposes 
of  indicating  the  particular  area  being  discussed  and  have  no  bearing  on  the 
solution  of  the  problem  whatsoever. 

The  problem  then  is  this.   Each  area  has  b..en  assigned  a  symbol  other 
than  the  above  identifying  letters  according  to  a  predetermined  olan.   Your 
task  will  be  to  discover  the  symbols  belonging  to  the  areas  which  have  their 
identifying  letters  circled.   This  may  bi  accomplished  by  asking  the  symbols 
for  any  area  other  then  the  ones  circled.   Decide  which  area  you  would  like  to 
know  first.  Then  ask  for  its  symbol.   Continue  working  in  this  fashion  until 
you  feel  you  have  sufficient  information  to  specify  accurately  the  symbols 
for  the  areas  with  the  circled  letters. 


Note:   The  rationale  underlying  the  assignment  of  numbers  to  the  various 

areas  is  as  follows:  beginning  with  ar^a  "J"  and  proceeding  downward 
by  successive  columns,  numbers  were  assigned  the  areas  according  to 
their  relative  position  in  a  sequence  of  numbers  formed  by  an  alter- 
nating series  of  first  three  positive  and  tben  three  negative  numbers 
in  the  order  of  increasing  absolute  magnitude.  Each  series  increases 
in  absolute  magnitude  independently  of  the  other,  though,  of  course, 
undergoing  interruption.  The  positive  series  begins  with  "2"  and  the 
negative,  with  "-3". 


Solution:   A  =  -5,   E  =  -9 
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Instructions  for  Problem  36  F 


Each  of  the  areas  in  the  accompanying  figure  are  identified  by  means  of 
the  letters  found  printed  in  them.   These  letters  are  merely  for  the  purposes 
of  indicating  the  particular  area  being  discussed  and  have  no  bearing  on  the 
solution  of  the  problem  whatsoever. 

The  problem  then  is  this.   Each  area  hae  been  assigned  a  symbol  other  than 
the  above  identifying  letters  according  to  a  predetermined  plan.   Your  task 
will  be  to  discover  the  svmbols  belonging  to  the  areas  which  have  their 
identifying  letters  circled.   This  may  be  accoraulished  by  asking  the  symbols 
for  any  area  other  than  the  ones  circled.   Decide  which  area  you  would  like 
to  know  first.  Then  ask  for  its  symbol.  Continue  working  in  this  fashion 
until  you  feel  you  have  sufficient  information  to  specify  accurately  the 
symbols  for  the  areas  with  the  circled  letters. 


Note:  The  rationale  underlying  the  assignment  of  values  to  the  various  areas 
is  as  follows:  the  value  for  each  area  depends  upon  both  the  color  and 
type  of  borders  of  the  area.  The  values  of  each  border  were  summed  to 
get  the  value  of  the  area.  Blue  straight  borders  have  a  value  of  "4"; 
dotted  blue  borders ,  a  value  of  "3";  curved  blue,  "2".  Red  straight 
borders  have  a  value  of  "a";  red  dotted  borders,  a  value  of  "b";  red 
curved  borders,  a  value  of  "c". 


Solution:   D  =  4+3+2+c  =  9+c,   I  =  2+2a+b. 
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Problem  36F 


G) 


Key 

■4+4+2+2="    4+3+2+c=   4+4+3+c=' 4+4+4+2= 


12 


9  +  c 


11  +  c 


14 


4+3+2+c=      3+3+2c=  i  4+3+3+c= , 4+4+2+b=| 

9+c       I         6+2c  1(l+c__        _l°+b_J 

4+3+2+c=    3+3+2+c=  ;  3+3+2+a= \ 4+2+a+b=j 

9+c        ':          8+c  ■         8+a      i,      6+a+b  j 


Note:  lines  or  por- 
tions of  lines  with 
dots  along  both  sides 
appeared  in  red  in 
the  original. 


;4+4+2+c=, 4+2+b+c=  ,'2+2a+b=  4+4+2+a= 
10+c  ';   6+b+c  !■  2+2 a+b  ,!'  10+a 

;4+4+4+c=  1.4+4+ 3+c=  '  4+3+2a=  ,J4+4+4+a=j 
!   12+c     11+c   I   7+2a   !'  12+a 
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Problem  26 


Instructions  and  Corresponding  Questions  and  Answers 

There  are  objects  called  Ks.  Your  task  is  to  find  out  how  many  of  the 
Ks  are  also  lis .   K  might  be  a  shorthand  way  of  saying  college  student,  and 
M  a  shorthand  way  os  saying  Cub  fan.   Then  the  problem  would  be  to  find  out 
how  many  college  students  are  Cub  fans.   Or  K  might  stand  for  Democrat,  and 
M  stand  for  red  haired.   Then  the  problem  would  be  to  find  out  how  many  Deno- 
crats  are  red  haired. 

Begin  by  reading  over  all  the  questions.   Decide  on  the  first  question 
you  would  like  to  have  answered,  and  write  its  number  on  the  page  provided. 
Then  take  the  card  from  the  folder,  and  read  the  answer  on  the  back.  Then 
decide  on  the  next  question  you  would  like  to  have  answered.   Write  down  its 
number  and  take  the  card  from  the  folder.   When  you  are  satisfied  that  you 
have  arrived  at  the  answer,  stop  taking  cards  and  write  down  your  answer. 
Remember,  you  may  use  as  many  cards  as  you  need  to  find  the  answer,  but  don't 
draw  more  cards  than  you  need. 


Questions 

1.  How  many  kinds  of  Ks  are  there?  1. 

2.  How  many  of  the  Ks  are  Ps?  2. 

3.  How  many  of  the  Ks  are  Bs?  3. 

4.  How  many  of  the  Ks  are  Ls?  4. 

5.  How  many  of  the  Ks  are  Ds?  5. 

6.  Is  a  P  also  an  M?  6. 

7 .  How  many  B  s  are  Ms  ?  7 . 

8.  Are  Ks  of  the  B  kind  also  Cs?  8. 

9.  How  many  Ls  are  M?  9. 

10.  May  a  K  be  both  a  P  and  a  B?  10. 

11.  May  a  K  be  both  a  P  and  an  L?  11. 

12.  May  a  K  be  both  a  B  and  an  L?  12. 

13.  How  many  Ds  are  M?  13. 

14.  Are  Ks  of  the  D  kind  also  Cs?  14. 


Answers 

There  are  three  kinds:      P,  B  and 

L. 

One  half  of  the  Ks  are  Ps. 

One  fourth  of  the  Ks  are  Bs. 

One  fourth  of  the  Ks  are  Ls. 

None  of  the  Ks  are  Ds. 

A  P  is  an  M  only  when  it  is  not 

a  K.   Ks  of  the  P  kind  cannot 

be  M. 

All  Bs  that  are  also  Cs  are  Ms. 

No,  Ks  of  the  B  kind  are  not  Cs. 

None  of  the  Ls  are  M. 

No,  a  K  cannot  be  both  a  P  and 

a  B. 

No,  a 

an  L. 

No,  a 

an  L. 

All  D; 


K  cannot  be  both  a  I  and 


K  cannot  be  both  a  B  and 


that  are  not  Cs  are  M. 
There  are  no  Ks  of  the  D  kind. 


Solution:   None  of  the  Ks  are  also  Ms, 
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Problem  41  A 


Instructions  and  Corresponding  Questions  and  Answers 

At  a  textile  factory  in  a  small  town  the  telephone  system  connecting  the 
various  factory  offices  is  rather  primitive.  However,  communication  between 
offices  is  greatly  aided  by  the  network,  since  the  offices  are  considerably 
separated. 

Basically,  the  factory  has  a  north  wing  comprising  offices  A,  B  and  C, 
and  a  south  wing  in  which  are  offices  D,  E,  F,  G  and  H.  At  the  time  the 
phones  were  installed  only  seven  were  available  and  consequently  office  G  is 
without  one.   Because  of  the  way  in  which  the  phones  have  been  wired  certain 
limitations  have  been  placed  on  their  use.  The  limitations  are  these: 

1)  There  is  not  a  single  phone  from  which  all  the  other  offices  with 
phones  may  be  called. 

2)  The  fact  that  one  office  can  call  another  does  not  necessarily  mean 
that  the  last  office  can  call  the  first. 

With  this  present  confusion  in  the  telephone  network  a  worker  in  office 
B  would  like  to  contact  someone  in  office  H.  What  is  the  most  efficient  way 
in  which  this  can  be  accomplished. 


Questions 

1.  Is  there  a  line  from  any  office  in 
the  north  wing  to  H? 

2.  Which  office  can  issue  outgoing  calls 
to  the  greatest  number  of  other 
offices? 

3.  What  offices  can  office  C  call? 

4.  Can  office  A  call  office  H? 

5.  From  which  offices  in  the  south 
wing  can  office  H  receive  calls? 

6.  What  offices  in  the  north  wing  can 
call  offices  in  the  south  wing? 

7.  Can  every  office  in  the  north  wing 
call  every  office  in  the  south  wing? 

8.  Can  office  B  call  office  A? 

9.  What  offices  in  the  north  wing  can 
call  office  C? 

10.  Can  office  C  call  office  B? 

11.  What  offices  can  office  H  call? 

12.  Can  every  office  in  the  south  wing 
call  every  office  in  the  north  wing? 

13.  What  offices  can  office  E  call? 

14.  Can  office  B  call  office  H? 

15.  Can  any  office  in  the  south  wing  call 
any  office  ii.  the  north  wing? 


Answers 

] . 

No. 

2. 

Office  E. 

5. 

Offices  D  &  E. 

4. 

No. 

5. 

Only 

from  office 

D. 

6. 

Only 

office  C. 

7. 

No. 

a. 

Yes. 

9. 

Only 

office  B. 

10. 

Mo. 

11. 

None 

12. 

No. 

13. 

Offices  A,  B,  C, 

D, 

14. 

No. 

15. 

Yes, 

only  office 

E. 

D,  and  F, 


Solution:   B-»C->D-»H. 
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Figure  1.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Ignatius  Control  and  Experimental  Subjects  on  Prt-Training 
Problem  1  and  Values  of  Ratios. 
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Figure  2.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Ignatius  Control  and  Experimental  Subjects  on  Pre-Training 
Problem  19  and  Values  of  Ratios. 
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Figure  3.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Ignatius  Control  and  Experimental  Subjects  on  Pre-Training, 
Problem  25  and  Values  of  Ratios. 
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Figure  4.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Loyola  Control  and  Experimental  Subjects  on  Pre-Training 
Problem  1  and  Values  of  Ratios . 
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Ffgure  5.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Perforaar.c.'p  of  L"?o.<,a  •-.:■: -ol  &n<l   Experimental  Subjects  on  Pre-Training 
Problem  19  and  Values  of  Ratios. 
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Figure  6.   Ellipsoids  and. Corresponding.  Parallelograms  Generated  by 
Performances  of  Loyola  Control  and  Experimental  Subjects  on  Pre-Training 
Problem  25  and  Values  of  Ratios. 
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Figure  7.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Ignatius  Experimental  Groups  h   and  B  on  Mid-Training 
Problem  31C  and  Values  of  Ratios. 
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Figure  8.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Ignatius  Experimental  Groups  A  and  B  on  Mid-Training 
Problem  35A'  and  /alues  of  Ratios. 
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Figure  9.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Ignatius  Experimental  Groups  A  and  B  on  Mid-Training 
Problem  32E  and  Values  of  Ratios. 
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Figure  10.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Ignatius  Experimental  Groups  A  and  B  on  Mid-Training 
Problem  36E  and  Values  of  Ratios. 


Appendix  II 


' 


11. 


1 .00  J 


Si 


: 

/ 

.80f 

/  / 

I 

| 

// 

.60-1 

1/ 

I 

I 

// 

// 

// 


// 


20 J      / 

// 

-^zz L~ 

0             2 

4             6 
Order 

Group  A 
Ratio   =    .8432 


8  10 


Chi  Square  =  6.2685+ 


1.00, 


Si 


.80 


.60- 


.40* 


,20' 


/ 


/  /  / 

/  /  / 

/  / 
/  / 


Group  3 
Ratio  =  .5820 


2     4      6 

Order 


8     10 


Figure  11.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Loyola  Experimental  Groups  A  and  B  on  Mid-Training 
Problem  3iC*  and  Values  of  Ratios. 
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Figure  12.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Loyola  Experimental  Groups  A  and  B  on  Mid-Training 
Problem  35A'  and  Values  of  Ratios. 
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Figure  13.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Loyola  Experimental  Groups  A  and  B  on  Mid-Training 
Problem  32E  and  Values  of  Ratios. 
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Figure  14.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Loyola  Experimental  Groups  A  and  B  on  Mid-Training 
Problem  36E  and  Values  of  Ratios. 
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Figure  15.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Ignatius  Control  and  Experimental  Subjects  on  Post-Training 
Problem  1  and  Values  of  Ratios. 
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Figure  16.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Ignatius  Control  and  Experimental  Subjects  on  Post-Training 
Problem  19  and  Values  of  Ratios. 
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Figure  17.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Ignatius  Control  and  Experimental  Subjects  on  Post-Training 
Problem  25  and  Values  of  Ratios. 
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Figure  18.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Ignatius  Control  and  Experimental  Subjects  on  Post-Training 
Problem  31D'  and  Values  of  Ratios. 

Appendix  II 


19. 


1.00^ 


,80 


,60- 


2i 


,20 


/ 


Group  A 
.40  Ratio  =  .3856 


4     6      8      10 
Order 


Chi  Square  =  .5673 


1.00 


.80  // 


/ 


: 


.60 |        /  / 

2i       |  '  Group  B 

/  /  Ratio  =  .9144 

.40r     /  / 

/  / 

\U^A 

0      2     4     6      8     10 
Order 


Figure  19.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by- 
Performances  of  Ignatius  Experimental  Groups  a   and  B  on  Post-Training 
Problem  31D'  and  Values  of  Ratios. 
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Figure  20.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Ignatius  Control  and  Experimental  Subjects  on  Post-Training 
Problem  35B'  and  Values  of  Ratios. 
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Figure  21.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performance  of  Ignatius  Experimental  Groups  A  and  B  on  Post-Training 
Problem  35B'  and  Values  of  Ratios. 
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Figure  22.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Ignatius  Control  and  Experimental  Subjects  on  Post-Training 
Problem  32F  and  Values  of  Ratios. 
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Figure  23.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Ignatius  Experimental  Groups  A  and  B  on  Post-Training 
Problem  32F  and  Values  of  Ratios. 
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Figure  24.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Ignatius  Control  and  Experimental  Subjects  on  Post-Training 
Problem  36F  and  Values  of  Ratios. 
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Figure  25.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Ignatius  Experimental  Groups  A  and  B  on  Post-Training 
Problem  36F  and  Values  of  Ratios. 
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Figure  26.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Ignatius  Control  and  Experimental  Subjects  on  Post-Training 
Problem  26  and  Values  of  Ratios. 
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Figure  27.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Ignatius  Control  and  Experimental  Subjects  on  Post-Training 
Problem  41A  and  Values  of  Ratios. 
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Figure  28.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Loyola  Control  and  Experimental  Sxibjf.ct.s  on  Pos (--Training 
Problem  1  and  Values  of  Ratios. 
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Figure  29.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Loyola  Control  and  Experimental  Subjects  on  Post-Training 
Problem  19  and  Values  of  Ratios. 
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Figure.  30.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Loyola  Coaf.rol  and  Expp.rimc-ntal  Subjects  on  Post-Training 

Problem  25  and  Values  of  Ratios. 
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Figure  31.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Loyola  Control  and  Experimental  Subjects  on  Post-Training 
Problem  31D*  and  Values  of  Ratios. 
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Figure  32.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Loyola  Experimental  Groups  A  and  B  on  Post-Training 
Problem  31 D*  and  Values  o£  Ratios. 
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Figure  33.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Loyola  Control  and  Experimental  Subjects  on  Post-Training 
Problem  353'  and  Values  of  Ratios. 
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Figure  34.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Loyola  Experimental  Groups  A  and  B  on  Post-Training 
Problem  35B'  and  Values  of  Ratios. 
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Figure  35.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Loyola  Control  and  Experimental  Subjects  on  Post-Training 
Problem  32F  and  Values  of  Ratios. 
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Figure  36.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Loyola  Experimental  Groups  A  and  B  on  Post-Training 
Problem  32F  and  Values  of  Ratios. 
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Figure  57.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Loyola  Control  and  Experimental  Subjects  on  Post-Training 
Problem  36F  and  Values  of  Ratios. 
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Figure  38.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Loyola  Experimental  Groups  A  and  B  on  Post-Training 
Problem  36F  and  Values  of  Ratios. 

Appendix  II 


Si 


1.00  T 


,80 


.60  f 


.40    - 


39. 


/ 
/ 
/ 

/  ,  - 


Control 
Ratio  =    .7180 


.20 


/ 


/ 


/ 

__z , 

6  8 

Order 


10  12  14 


1.00  f 


.80   I- 

i 


Si 


,60 


.40  f 


Chi  Square  =   3.8017 


/ 

/ 

/       / 


/ 


Experimental 
Ratio  =  .7874 


.20 


/ 


6      8 
Order 


— i _,. 

io    i; 


— -t 

14 


Figure  39.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
Performances  of  Loyola  Control  and  Experimental  Subjects  on  Post-Training 
Problem  26  and  Values  of  Ratios. 
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Figure  40.   Ellipsoids  and  Corresponding  Parallelograms  Generated  by 
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Problem  41A  and  Values  of  Ratios. 


Appendix  II 


< 

r-l 

N"( 

= 

0 

(0 

•p 

1— 1 

X) 

oO 

o 

c 

u 

■H 

p- 

■a 

u 

u 

o 

o 

o 

<u 

o 

< 

a 

+-> 

a. 

CO 

3 

S 

o 

o 

Sj 

-- 

O 

o 

ro 

£ 

r-l            O 

a) 

cd 

,ci 

0)         w 

-p 

.O          o 

C 

cfl           +j 

o 

H 

b0  X) 

C 

CJ 

•H 

if) 

-a 

c3 

C! 

CQ 

o 

a.  T3 

OT 

0 

Q> 

J3 

Sj 

+j 

S-i 

a 

o 

S 

u 

&u 

to 

c 

a) 

■^ 

a 

jj 

r— 1 

o 

a 

o 

p> 

CO 

CJ 

£■ 

+J 

cn   <o 

c 
o 


O 


o 

O 

o 

o 

O 

o 

o 

o 

o 

o 

o 

o 

r-H 

r-H 

.— 1 

O 

o 

o 

o 

lfl 

IA 

cm 

CM 

O 

O 

o 

O 

o 

O 

in 

m 

CN 

c\ 

O 

O 

o  o 

o  o 

m  in 

CN  nj 

o  o 


o  o 

o  o 

m  m 

(N  CM 

o  o 


c 

o 

o 

o 

o 

o 

o 

o 

f^l 

r- 

o 

o 

o 

o 

o 

o 

in 

in 

o 

o 

c 

o 

o 

o 

o 

o 

m 

m 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

r— 1 

o 

o 

c 

o 

o 

o 

o 

c 

o 

r— i 

o 

o 

c 

o 

o 

o 

o 

o 

r-H 

o 

o 

c 

o 

o 

o 

o 

IT, 

m 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

c 

r-H 

o 

o 

o 

o 

c 

o 

IT, 

m 

c 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

r-H 

o 

o 

o 

o 

c 

o 

o 

o 

X 

T-. 

£ 
"J 
ft 
ft 


HtMKi^ifiiohco(ji2      wr9 


o  o 

o  o 

o  o 

o  o 


a 

O 

-j 

+J 

bO 

O 

C 

l-J 

•M 

a< 

00 

TJ 

tj 

u 

C 

o 

o 

IM 

o 

«! 

a) 

+j 

t^ 

a 

cfl 

D 

E 

C 

"J 

u 

43 

O 

1/3 

43 

CO    VC 

CN 

0 

<3 

Cl 

cfl 

43 

0 

a 

w 

-P 

•■-1 

■— i 

4J 

J2 

c 

G 

CO 

« 

+-> 

o 

QJ 

H 

3  m 

bO  T) 

o- 

C 

Q> 

•w 

CO 

TT 

cfl 

c 

B 

o 

d.  13 

<t 

CO 

o 

y 

43 

u 

■*-> 

i-i 

QJ 

o 

§ 

O 

to 

►n 

U) 

c 

<U 

•H 

D 

M 

r-i 

O 

C3 

u 

> 

O 

43 

CM 

o 

c 

o 

o 

m 

m 

CN 

CM 

o 

O 

o 

o 

o 

o 

m 

m 

CN 

CN 

O 

o 

o 

O 

o  o 

o  o 

m  in 

CM  CN 

o  o 


o  o 

o  o 

in  m 

CN  CN 

o  o 


o 

o 

o 

o 

o 

o 

o 

o 

<J- 

■o 

o 

o 

o 

o 

o 

o 

o 

c 

o 

I— 1 

3 

o 

O 

o 

o 

o 

in 

in 

o 

o 

o 

o 

o 

c 

o 

o 

m 

m 

o 

o 

o 

o 

o 

o 

c 

o 

o  o 
o  o 
m  m 


o  o 

o  o 

o  o 

o  o 


HCNK1<fiAChffl(Jv 


o 

o 

n 

in 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

H 

o 

0 

w 

rj 


to  o 

C     U 


O 

<;   a 

+j 

CX   CO 

a   S 

O     0) 

^  ij 

o    <-> 

CO 

J3 

tr\ 

O     CJ 

cd  .e 

0) 

W    -P 

rH 

^j 

o    C 

a 

+J    o 

H 

toO  T3 

a   cj 

•H      01 

T3     CO 

C    CO 

O 

Cu  "O 

en    O 

a)  .£ 

U    4-> 

u    o 

o  2 

O 

to 

w    C 

a)  -h 

3     C-" 

i-H      O 

ca   a 

>   CO 

0) 

x: 

+j 

o 

o 

o 

o 

c 

o 

o 

o 

o 

o 

o 

o 

1— 1 

r-l 

t-t 

o 

o 

c 

o 

in 

m 

CN 

CM 

o 

o 

o 

o 

c 

o 

m 

ir, 

CAJ 

C-l 

o 

O 

03    MD 

ir» 

in 

c 

CN 

CM 

c 

O 

a 

■H 

+J 

en 

o 

o 

o 

a  m 

c 

c 

o 

o 

o 

o 

c 

<r 

LO 

in 

CN 

CM 

o 

o 

O 

o 

o 

o 

o 

o 

o 

o 

ro 

f- 

O 

c 

o 

o 

o 

o 

m 

lt\ 

o 

o 

o 

c 

o 

c 

a 

a 

IT) 

ir\ 

o 

o 

O 

o 

o 

o 

o 

a 

3 

c 

o 

rH 

o 

O 

o 

C 

o 

o 

o 

o 

o 

^ 

a 

o 

o 

c 

o 

o 

IA 

un 

o 

o 

o 

o 

o 

o 

o 

o 

o  o 

o  o 

o  o 

o  o 


y. 

-a 

c 

& 

CL 


H    (N    l^    <t    1«    lO    MS    P 


o  o  o  o 

o  o  o  o 

o  o  o  o 

O  O  O  O 


o  o 

o  o 

o  o 

o  o 


o  o 

o  o 

o  o 

o  o 

O  r-H 


0 

G) 

4J 

r- 1 

X) 

b0 

0 

o  o 

c 

r-l 

o  o 

•r-l 

PM 

CD 

m  m 

T3 

CM    (N 

u 

U 

o  o 

o 

C 

a 

U-l 

o 

o  o 

< 

r~ 

o  o 
m  m 

=u 

c 

eg  cm 

p 

e 

C   O 

0 

a 

u 

x. 

o 

a 

GO 

O 

o 

a 

« 

'O 

o 

<]■ 

o 

£■ 

c 

o 

cfl 

tf 

0 

M 

0) 

a 

+J 

■rl 

1—1 

+J 

X) 

o 

C 

CO 

c 

4-J 

c 

G) 

H 

P 

IA 

b0  T3 

o 

C 

(!) 

•r-1 

S3 

-o 

c 

c 

PQ 

o  o 

o 

o  o 

a.  'v 

<f 

m  m 

CO 

0 

(M    CM 

cj 

jC 

o  o 

i-i 

+-> 

M 

o 

0 

g 

o  o 

u 

CO 

^ 

o  o 

CO 

c 

CM    CM 

a 

•r-l 

o  o 

3 

-J 

r— 1 

c 

CO 

0> 

O 

> 

CN 

o 
o 

o 

r-l 

o  o 

o  o 

o  o 

o  o 

O  r-H 


o  o 

o  o 

o  o 

in  m 

o  o 


o  o 

o  o 

o  o 

m  m 

o  o 


o  o 

o  o 

o  o 

o  o 

r-l  O 


o  o 

o  o 

o  o 

o  o 

O  r-l 


o  o 

o  o 

o  o 

m  in 

o  o 


o  o 

o  o 

o  o 

m  m 

o  o 


o  o 

o  o 

o  o 

o  o 

r-l  o 


H 
H 

M 

X 
■r-l 
-3 
a 
a 
Cu 
ft 
•J 


o  o 

o  o 

o  o 

o  o 

O  r-4 


•4 

f"> 

ro 

e 

o 

i) 

+-> 

i— i 

£5 

uo 

O 

c 

!j 

■r-l 

(-, 

-o 

u 

U 

0 

0 

CJ 

<->-) 

a 

< 

a 

+-> 

CL 

0 

3 

a 

o 

j 

h 

JS 

O 

a 

w 

£) 

O 

?J 

d 

J^ 

M 

4-J 

O 

c 

•u 

0 

bO  TS 

C 

0) 

>rt 

CO 

■a 

c3 

c 

a 

o 

a.  -a 

en 

o 

-j 

£! 

u 

-y 

h 

y 

o 

S 

O 

CO 

i/1 

c 

0) 

•H 

3 

(-1 

r— 1 

0 

CC 

0 

> 

CO 

0) 

,£3 

m 

ON 

ON 

m 

o 

o 

CO 

t> 

f» 

o 

1— 1 

—I 

o 

o 

o 

IT, 

o 

in 

iri 

o 

lf\ 

oo 

t"« 

X) 

o 

^H 

o 

c 

o 

a 

m 

ON 

m 

10 

o 

in 

CO 

r> 

X 

O 

r-H 

3 

o 

o 

O 

ON    ON    -* 

o  o  r- 


O   O 


o 

c> 

KN 

\o 

l-n 

ON 

r-» 

r-H 

r\i 

<t 

<f 

N-l 

a 

O 

ON 

K-l 

1 

[-■ 

<t 

C\l 

►0 

•* 

<t 

CM 

►0 

<f 

a 

o 

a 

CM 

a 

cn 

o 

o 

a 

ts 

<; 

c 

I*" 

o 

o 

a 

a 

CM 

o 

C- 

a 

■O 

a 

r- 

o 

o 

a 

C\ 

a 

ON 

a 

VO 

o 

r> 

a 

o 

hA 

o 

ON 

a 

^D 

o 

f-> 

o 

o 

a 

<f 

f^ 

a 

c 

o 

CM 

o 

CN 

o 

VC 

a 

r- 

o 

a 

a 

CM 

a 

ON 

o 

vo 

H 
H 
H 

•-< 
C 

<u 
o. 
a 

< 


r-irNN^-d-Ln^oi^-oooN 


Oh    IN   >0 


3  ZJ      ■* 


Ifi 

CT\ 

Ifl 

m 

O 

in 

00 

P^ 

CO 

O 

H 

o 

o 

o 

o 

o    ON 
Kl   vo 


£ 

O      Q) 

4-1    i-t 

X> 

b£)   O 

C     f-t 

TJ    ^ 
U     ^ 

o   o 

CJ   <w 

o 

-M 

a.  n 

3  S 
O  CJ 
h  jC 
O  cj 
co 

y  ° 

o   c 


•r-l  Cfl 

T3  CD 

c  m 
o 

a  -a 

CO  O 

qj  x: 

^  +j 

u  a 

o  S 
o 

to 

to  d 

Q)  T-( 

0  (-> 

r-l  O 

CD  O 

P>  CO 


CJ 


ir\ 

C?N 

a> 

ifl 

a 

o 

X 

r- 

r>- 

c 

—I 

—i 

o 

O 

o 

m 

ON 

ir\ 

to 

c 

in 

00 

r- 

CO 

3 

—i 

o 

c 

o 

o 

CTv  C\  <f 

"3  O  t^ 

r^  r^  cm 

r-l  rH  ■* 

O  O  O 


On  CTn  IT, 

i— i  r-i  m 

<f  <t  CO 

N1  N"|  O 

O  C  O 


CI 

CM 

o 

o> 

3 

lO 

o 

f» 

o 

o 

N~\ 

cr 

r^ 

r—i 

CM 

<f 

<f 

fT\ 

D 

o 

o\ 

N"l 

r-H 

o 

<f 

^M 

■'~\ 

o- 

"3 

o 

o 

r- 

-3 

o 

o 

CM 

o 

0> 

o 

'O 

o 

f- 

o 

3 

CM 

o 

a\ 

o 

o 

c 

r» 

pH 

Ol 

<f 

<f 

>0 

O 

o 

N^ 

o 

o 

o 

o 

o 

r- 

o 

o 

o 

o 

CM 

o 

ON 

o 

o 

o 

r- 

o 

o 

c 

."J 

o 

ON 

c 

IQ 

H 

H 

X 
■H 

-a 
c 
a 

C- 


-h   cm  N-i  <t   in  vo  r^ 


M 


in  on  in 
mom 

CO  t^-  00 
o  i-i  o 
o  o  o 


X 

ifi 

CN    ON 

bO 

o 

O 

in 

o  o 

c 

tj 

00 

f»  t» 

•H 

cu 

'""' 

o 

i— 1     i-H 

X) 

o  o 

M 

(j 

O 

o 

ON 

0> 

m 

a 

<-i-J 

^H 

l-H 

m 

a 

on 

>* 

o- 

CO 

< 

ffl 

r-O 

(O 

o 

4-> 

o 

o 

o 

ft 

cfl 

S 

S 

o 

U 

u 

,£i 

cc 

o 

o 

CO 

x: 

CO 

r-- 

u 

0 

,0 

c3 

J3 

0 

m 

4-> 

•r-l 

4-1 

r^ 

Xi 

c 

5 

CO 

S 

■p 

0 

Q> 

H 

3 

o> 

ON     ■* 

bO  TD 

O 

o 

o  r-* 

C 

M 

^c 

f- 

r-  <N 

•^ 

to 

IH 

H     -* 

TO 

to 

c 

o  o 

c 

PQ 

o 

ft  TO 

CO 

o 

m 

0) 

-d 

U 

+-> 

u 

cj 

c 

S 

o 

bO 

<f 

CO 

C 

<y 

•r-l 

^ 

S-i 

r-l 

0 

re 

u 

> 

CO 

N"l 

<-Hrsitn<tmvor,"000>^^ 


O    rH     CN    N~l 


ps 

(N 

3 

Cv 

KO 

o 

O 

(N 

o 

CN 

o 

VD 

e 

P» 

3 

c 

ON 

N"l 

— i 

ps 

<t 

r\i 

nN 

<f 

o 

O 

ON 

lO 

1— 1 

r> 

•» 

CN 

ro 

<t 

o 

o 

Ml 

Cn 

r» 

T— 1 

CM 

<r 

•3 

^n 

O 

O 

N-l 

O 

ON 

O 

lO 

o 

r» 

o 

o 

o 

o 

CM 

o 

ON 

o 

*0 

o 

P» 

o 

o 

o 

CM 

o 

ON 

3 

VC 

o 

f> 

3 

o 

CM 

o 

ON 

o 

'•O 

o 

r- 

o 

c 

o 

o 

CM 

o 

CA 

o 

VC 

o 

r-« 

o 

o 

o 

CM 

o 

ON 

o 

lO 

o 

r« 

o 

o 

o 

cm 

c 

'ON 

o 

*£ 

o 

r* 

o 

c 

<t 

03 

r- 

( — 

!N 

vfr 

>* 

►0 

o 

o 

o 

CM 

o 

ON 

3 

IC 

o 

r- 

o 

O 

no 

o 

W 

X 

-a 

ex 
ex 

< 


S 

O     (1) 

+j  t-t 

.Q 

00   O 

c   u 

■H  eu 

X) 

u    u 

o    0 

O     (4-1 

o 

<    CO 

■P 

(X    OJ 

3  e 

o    a> 

1-4      £ 

o  y 

co 

^cj 

CO 

"b    a) 

c3  xi 

o> 

W    +J 

— t 

£> 

o  c 

a) 

+■»    o 

H 

toO  TD 

C    o> 

•i-4      CO 

T3     CO 

c  m 

0 

&4    T3 

co    o 

4)   X! 

Cj    +J 

!j    q) 

O  S 

O 

toO 

co    C 

a)  -h 

3  j-i 

i-i    o 

cd  o 

>    CO 

<u 

£! 

o 
•1-1  l> 


O 


ON 

On 

CTi 

o 

ON 

o> 

o 

o 

o 

^H 

—1 

H 

o 

o 

o 

o\ 

XI 

on 

ON 

C-. 

on 

o 

<— < 

O 

r-4 

CM 

r^ 

o 

C 

o 

ON 

X 

CN 

CN 

CTi 

c\ 

O 

i— 1 

o 

On  NO 
CTi  ON 
O    Ml 


NO 

1-H 

r^ 

CN 

CN 

r> 

"- 

<f 

CN 

t> 

r^ 

m 

c- 

on 

CN 

Ml 

wi 

-J 

o 

o 

«3 

VO 

o 

ON 

Ml 

<M 

•d- 

Ml 

o 

o 

vo 

NO 

CN 

ON 

Ml 

CN 

<r 

Ml 

o 

O 

o 

CN 

Q 

7n 

C 

VO 

O 

r^ 

o 

o 

o 

CN 

c 

Cn 

c 

NO 

o 

Is" 

o 

O 

o 

CN 

o 

ON 

o 

NO 

o 

t- 

c 

o 

o 

CN 

c 

ON 

c 

NO 

o 

l> 

o 

o 

MN, 

Q 

ON 

O 

VO 

o 

r- 

Q 

c 

O 

<f 

cc 

ON 

CTi 

o- 

1-4 

IT| 

CN 

o 

O 

o 

CN 

o 

ON 

c 

NO 

3 

» 

c 

C 

o 

CN 

o 

ON 

o 

NO 

o 

r^ 

o 

Cj 

o 

CN 

3 

ON 

o 

VO 

o 

r- 

o 

o 

o 

CN 

o 

CN 

- 

VC 

o 

o 

o 

o 

DO 

0 

yN 

>J 

•a 

= 

o 


CO 

CO 

CO 

CO 

co 

O    SO 

00 

CO 

CO 

J3 

CO 

<J-    ITl 

PO 

m 

m 

IT) 

in 

Lf\ 

os  o 

o 

O 

o 

O 

o 

cm  i> 

l-l 

VO 

rH 

-3- 

O    CO 

O  ao 

O    IA 

o  o 

OS    Os 

rH 

rH 

CM    CM 

o 

o 

O    O 

t> 

r~~ 

«tf   -vi- 

■-i 

<* 

<* 

CS     OS 

r-l 

r— 1 

CM    CM 

o 

c 

o  o 

< 

r^ 

r- 

<f    vt 

W 

rH 

<f 

<f 

as  as 

IO 

rH 

r— 1 

CM    CM 

O     0) 

c 

O 

o  © 

O    CO 

+J  f-1 

rO 

rH 

o  co 

XI 

o  m 

toO  0 

o  o 

C    (h 

•d  ph 

O    CO 

(J    U 

r-H 

O    CO 

o  m 

o  o 

o  o 

o  y-i 

u 

o  co 

<C    OS 

,— l 

o  oo 

+J 

o  m 

Cu  crj 

1-4 

o  c 

3  e 

O    0) 

t- 

r- 

>*    vf 

In   XI 

O 

--H 

■4 

<i 

OS    Os 

O    O 

i-H 

rH 

CM    CM 

xa 

o 

o 

O    O 

XJ 

Wl 

n\ 

y  9. 

TO    X3 

C 

0 

O  00 
O    CO 

Q) 

H  4-> 

•i-l   Os 

o  m 

i-) 

4-1 

o  o 

£> 

o  c 

CO 

ed 

-t->    o 

J 

O    00 

H 

bo-o 

C     0) 

•  r-l      CO 

13     <S 

c  m 

3 
O  00 

f- 

o  oo 
o  m 
o  o 

•4-  «* 

Os   Os 

o 

r^ 

r-l 

|H 

CM    CM 

CO 

O 

o 

O    O 

CO     O 

a>  x: 

r^ 

r» 

<t    <f 

^  +j 

<f 

-t 

Os    OS 

i-j    o 

yD 

rH 

rH 

CM    CM 

o  S 

O 

O 

O    O 

u 

bO 

O    00 

CD     C 

O    00 

Q)    -r4 

in 

o  m 

3    tJ 

o  o 

rH      O 

CO      O 

OD 

00    O 

>   CO 

<f 

03 

en 

OD    O 

m  o 

X! 
4-> 

o 

o  o 

r- 

r- 

<f  •* 

«* 

<r 

OS    Os 

*■> 

r-H 

o 

r-l 

o 

CM  CM 
O    O 

•*    <f 

OS    OS 

CM 

i—i 

o 

r— 1 
O 

CM    CM 

O    O 

o  OO 
O   ao 

rH 

o  m 

o  c 

In 

<u 

o 

T3 

r-l 

CM 

hO 

<t 

IA 

^0  w 

c 
a 
a, 
a 
< 


00  CO  CO  CO  00 

CO  CO  CO  CO  CO 

LT\  ITl  U-\  LT\  LPi 

o  o  o  o  o 


g 

O     0) 

■p  1-1 

^ 

uO   O 

c  u 

•-"    Pn 

t) 

u    u 

o   o 

y  n-i 

u 

<$     CD 

+j 

Cu  CO 

3     f= 

O     a) 

«-<  js 

o  y 

co 

o 

x: 

— 1 

o    a) 

n)   £5 

CJ 

W    +J 

■— < 

O 

o  c 

CS 

-P    o 

H 

W  T3 

C      Q) 

•i-l    en 

T3    cB 

C    pq 

O 

a  -a 

to    O 

CJ   A 

U    -P 

u   a) 

o  s 

CJ 

bO 

co    C 

CD      -l-l 

D        t4 

,-{     o 

ca    a 

>   CO 

-J 

x: 

<t  <t 

i—l     r— I 
O     O 


St    -* 

i— I    i— I 

o  o 


<t  <f 

i—l     r- ( 

o  o 


<t  st 

i-H     i—l 

o  o 


<f  <t 

■-H     i-l 

o  o 


o  SO 

<t  lA 

o>  o 

CM  r-- 

O  CO 

O  CO 

O  ITl 

o  o 

O  CO 

O  CO 

O  CO 

o  o 

<t  <t 

CM  CM 

o  o 

vt  <t 

Os  CP> 

<M  CM 

o  o 


CM  CM 

C  O 

O  CO 

C  CO 

O  "> 

o  o 


o  CO 

O  1A 

O  O 

<t  vt 

as  o\ 

CM  CM 

O  O 

<t  <t 

a*  as 

CM  CM 

O  O 

CO  O 

CO  o 

m  o 

o  o 

«*  <t 

a\  a> 

CM  CM 

o  o 

o  co 

o  CO 

o  m 

o  o 

<t  <t 

as  o 

CM  CM 


-a 
C 

0) 

o 
0 
< 


H    CM    hO    <t    lA 


CO 

CO 

CO 

cr 

co 

o  o 

, 

w 

CO 

co 

CO 

co 

CO 

<t  in 

en 

m 

in 

in 

m 

on  o 

o 

o 

C 

o 

O 

cm  r^ 

O    00 

t« 

O   00 

rH 

r-N 

[^ 

o  m 
o  o 

10 

o- 

<t 

On    ON 

r-H 

o 

rH 

<M   cm 

O   O 

O   co 

if\ 

C    CO 

r-* 

o  m 
o  o 

O 

O    CO 

LH 

<t 

O    CO 

SH 

rH 

o  in 

a 

o  o 

o 

0) 

O    CO 

4-> 

— i 

N~l 

o   CO 

o  m 

bO 

o 

o  o 

c 

5n 

•r-l 

ft 

r^ 

r» 

-d-  <}■ 

T3 

CM 

<)" 

■3 

ON     0> 

U 

u 

i — i 

r— t 

rH 

CM    CM 

o 

0 

C 

o 

o  o 

o 

—J 

CJ 

r- 

t~- 

o-  •* 

<! 

03 

4J 

r-H 

-J- 

rH 

r-' 

On    on 
<M    CM 

a 

cfl 

o 

o 

O    O 

a 

g 

c 

0) 

r-~ 

t*- 

<t    <T 

s-i 

^ 

O 

<t 

■tf 

ON     ON 

o 

O 

CO 

— I 

rH 

o 

i — I 

o 

CM     CN) 

c  o 

(-) 

xl 

w 

r-H 

u 

0) 

c 

o  co 

0) 

ca 

■d 

o 
•r4 

ON 

o  oo 
o  in 

—4 

+J 

o  c 

fl 

o 

c 

00 

cd 

4J 

o 

QJ 

O    CO 

H 

3 

CO 

O    CO 

fcO  T3 

O 

o  in 

C 

o 

o  o 

•  ri 

O) 

T) 

CO 

r~- 

r^ 

<f  -tf 

c 

bq 

p- 

<t 

<t 

ON     ON 

o 

rH 

r-H 

CM    CM 

&T3 

C 

O 

o  o 

C/j 

0 

a) 

£ 

c*- 

r- 

o-  <J" 

u 

+-> 

\C 

<t 

<r 

ON      ON 

u 

.^ 

r-i 

; — i 

CM    CM 

o 

S 

O 

c 

O    O 

u 

bO 

CO 

CO    O 

m 

C 

ir, 

CO 

00   o 

a) 

•r-l 

m 

in  o 

D 

tj 

3 

o  o 

--4 

0 

cC 

« 

O    CO 

> 

CO 

<r 

O    00 

o  in 

QJ 

o  o 

£1 

•p 

(O 

<• 

ON     ON 

r-1 

rH 

CM    CM 

o 

C 

r- 

t-^ 

O    O 

OJ 

<t 

<f 

ON     ON 

,H 

, — 1 

CM    CM 

o 

o 

o  o 

O    CO 

r-< 

O    CO 

o  m 
o  o 

U 

-co- 
in 

r-l 

CN 

^ 

«* 

in 

«W° 

c 
-J 

c 


CO 

CO 

CO 

CO 

CO 

o 

to 

w 

CD 

CO 

CO 

co 

CO 

«* 

in 

LA 

en 

in 

m 

m 

C\ 

o 

O 

o 

O 

Q 

o 

<N 

C 

CO 

t-. 

o 

00 

h 

t> 

t> 

o 
o 

m 
O 

vo 

•* 

<f 

CN 

cr. 

rH 

t-H 

o 

— i 
O 

CN 

o 
o 

CN 

c 

CO 

1T| 

o 

cc 

^H 

o 

o 

in 
o 

P 

o 

CD 

m 

<f 

o 

CO 

HI 

rH 

o 
o 

a 

s 

0 

CD 

r- 

t~ 

s* 

<t 

+J 

rH 

N1 

<* 

<i 

o 

o 

A 

r-H 

—i 

rH 

CN 

CN 

toO 

0 

O 

C 

O 

c 

c 

in 

■1-1 

P, 

l> 

f» 

<f 

<t 

-n 

CN 

<t 

<f 

CN 

'ON 

U 

S-J 

r— 1 

r-H 

— < 

CN 

CN 

o 

0 

O 

o 

O 

O 

a 

H-l 

o 

t> 

f- 

vf 

<f 

< 

03 

rH 

<t 

<f 

ON 

Cn 

+J 

r— ( 

T-* 

r- 1 

c\ 

CN 

c- 

a 

o 

o 

o 

O 

3 

8 

0 

o 

o 

CO 

u 

X! 

o 

c 

CO 

o 

a 

CO 

rH 

c 
o 

m 
o 

c\i 

rH 

o 

cy 

is. 

c 

o 

CO 

Cfl 

.£ 

c 

CN 

o 

:o 

<B 

H 

4- 

•H 

c 

m 

r-H 

*J 

o 

o 

-Q 

C 

c 

o: 

ffl 

*J 

0 

0! 

t> 

r^ 

<f 

<t 

H 

3 

<r 

>* 

Cn 

ON 

hO  X> 

a 

OJ 

r-H 

rH 

CN 

CN 

c 

a 

O 

o 

O 

o 

•H 

CO 

■a 

cd 

r» 

•> 

<r 

<f 

CJ 

(X 

r- 

<r 

<* 

o 

On 

O 

t—\ 

1 — 1 

CM 

CN 

Cu  TD 

o 

o 

O 

O 

OT 

c 

CD 

43 

C 

co 

u 

4-> 

O 

CO 

u 

a'- 

^j 

a 

m 

o 

S 

o 

O 

U 

00 

o 

co 

CO 

c 

o 

co 

<u 

■1-1 

LH 

o 

LO 

3 

h 

o 

o 

r^ 

c 

cd 

a 

r- 

r- 

<* 

-* 

£> 

w 

<t 

<r 

<t 

o 

c^ 

r-H 

r-H 

CN 

■N 

01 

o 

c 

O 

o 

-= 

+-> 

CN 

r-H 

u 

CO 
CO 
ITl 

o 

H 

O 

H 

o 

CO 
CO 

in 

o 

<J 

0> 
CN 

c 

o 

o 
o 
o 

o 

c 
O 

o 

ON 

CN 
O 

co 

CO 

in 

o 

CD 

"i 

Li 

r-H 

CN 

rO 

<r 

m 

W 

o 

-a 

c 

cj 

c. 


03 

o 

o 

o 

o 

0> 

in 

CO 

CO 

o 

K\ 

«* 

<t 

<f 

-J 

N"| 

r— 1 

CN 

o 

O 

r— 1 

. — i 

r— H 

r^ 

1 — t 

r-H 

in 

<f 

t"« 

r-< 

r> 

r^ 

r» 

t»- 

h- 

l> 

o 

*o 

in 

<t 

o 

o 

o 

c 

o 

o 

o 

o 

m 

<f 

«! 

r- 

fn 

a 

o  cj 

■p  -i 

rO 

uo  o 

c    S- 

■*    Pw 

T3 

u    u 

o   o 

CJ     <4-l 

a 

<j   co 

+-> 

Cu  ffl 

3  a 

0     CO 

t-l   xi 

O    cj 

CO 

m 

gj 

rH 

o   <d 

CO   xi 

CJ 

W    +J 

i—l 

.G 

o  c 

cd 

-P    o 

E-i 

c£  X! 

C    cj 

<i-l    co 

TJ    cfl 

C    PQ 

O 

a  T3 

CO     O 

cj  x: 

Sj     4J 

U     CJ 

o  S 

CJ 

bO 

CO     C 

CO   t* 

3  b 

o 

Cfl     CJ 

>  w 

CO 
X! 

J-1 


CI 

o 

■r-l 

+-> 

CO   t~- 
CJ 

3 
O 


cn 

r^ 

<f 

CO 

CM 

o 

r-l 

m 

-c 

CN 

<f 

o 

1*1 

rO 

O 

«tf 

r- 1 

o 

O 

o 

c 

«3 

r- 

a 

a 

o 

o 

O 

O 

c 

3 
C 

c 
O 

c 

CN 

i— I 
O 

CJ\ 

ON 

m 

CO 

CO 

m 

o 

o 

O 

o 

o 

r-~ 

o 

c 

c 

CO 

CO 

Kl 

<?■ 

r- 

CN 

CN 

CN 

o 

r* 

r~ 

CM 

CO 

CO 

<r 

<r 

<f 

o 

r— I 

i — i 

~M 

o 

t— i 

r-H 

r-H 

i — i 

a 

o 

c 

o 

o 

oj 

cn 

CM 

r^ 

o 

o 

o 

o 

c 

C 

O 

o 

O 

a 

<t 

Gn 

<f 

r^ 

W 

r-H 

c; 

^H 

r-H 

CN 

CM 

O 

cm 

in. 

'O 

N-l 

O 

rn 

>0 

c 

o 

o 

c 

O 

c 

o\ 


r~-  o>  o 

IO  ^  H 

CN  "1  <f  N"l 

O  i-l  CN  r-l 

O  O  O  O 

f^  CO  CD           CN  CN 

V£>  t~-  P-           <t  <!• 

CN  l-H  l-H                  1 — 1  ■ — I 

O  O  O           CN  CN 

o  o  o        o  o 

Ifl  is  CM  W  1^  >J 

"i  O  ^  co  m  -J 

in  a  h  ^  "i  o 

Q  -H  CN  r-H     O  O 

o  o  o  o  o  o 


o  o 


^csifA^m^or-co 


o  c 

m  ao 

o  o 

r-  c 

o  o 


cc 

cc 

m 

«tf 

CN 

r- 

r*- 

nj 

o 

r» 

r-< 

CN 

<f 

<r 

co 

CO 

<!■ 

o 

f— 1 

i-H 

CN 

o 

r-H 

r-H 

r-H 

t—< 

o 

o 

o 

O 

c 

CN 

CN 

CN 

t^ 

c 

O 

o 

o 

c 

O 

C 

O 

O 

o 

ki 

N"l 

m. 

,_l 

r» 

■— < 

,H 

o 

in 

r~- 

l> 

to 

r> 

r- 

CO 

O 

oo 

c 

CM 

o 

c 

o 

CN 

H 

, — 1 

o 

'C 

■ — i 

o 

o 

O 

o 

c 

o 

c 

o 

(^ 

o 

c 

o 

CN 

o 

<t 

o 

r^ 

c 

t~- 

o 

c 

«* 

CC 

r-H 

CN 

CN 

cy. 

m 

r^ 

O 

o 

o 

X] 

■a 

CJ 

& 
& 

< 


w 


0 

CO 

■p 

—i 

jD 

bO 

0 

c 

P 

•fl 

fu 

u 

U 

0 

0 

y 

U-l 

u 

■1. 

4 

+J 

a 

CO 

3 

£3 

o 

CD 

M. 

J3 

O 

a 

TO 

o 

CJ 

td 

A 

H 

+J 

bO  'O 

e 

CJ 

wi 

CO 

-c 

3 

c 

CQ 

o 

&  TD 

03 

O 

c; 

a 

5- 

4J 

!i 

CJ 

o 

s 

a 

oO 

CO 

C 

CJ 

>H 

3 

Cj 

r— 1 

0 

re 

o 

> 

CO 

<u 

xs 

+J 

o  o  o  in  CO 

<f  -J  lf|  H  Ol 

i— I  r-l  r-H  IA  >J 

r^  r-~  r-~  mo  \o 

o  o  o  o  o 


CN    r»  vf  CO 

r-l     LC\  v*  CM 

KMO  O  ■* 

o  o  o  o 

o  o  o  o 


CO  CD  rn  CTs  r^  CN  CN| 

«.        r-  r~  cm  co  co  <c  o- 

"           1-4  r-l  CM  O  i-l  t-H  rH 

1-1           O  O  3  O  CN  CM  CN 

o  o  o  o  o  o  o 


t*. 

O 

o 

c- 

mo 

m 

— 1 

>n 

en 

CM 
O 

o 

r-l 

o 

CN 

c 

►n 

r-l 

o 

i> 

co 

X) 

CM 

CN 

CN 

o 

r- 

l> 

■* 

•tf 

<r 

CO 

CO 

CM 

H 

■ — 1 

i — i 

r— 1 

r-H 

C 

o 

3 

c 

CM 

CM 

CN 

O 

o 

O 

c 

o 

CT 

O 

r-l 

■* 

CTs 

<f 

CO 

J— ( 

co 

— -» 

o 

r~- 

CM 

O 

CM 

a 

o 

3 

c 
o 

o 

co 

CO 

n~> 

<r 

CN 

r> 

r> 

r- 

f« 

C\| 

<r 

<r 

CO 

00 

o 

r~* 

r— < 

CM 

c 

n— < 

iH 

.— i 

o 

o 

O 

o 

CM 

CM 

CM 

O 

O 

c 

o 

O 

C 

O 

►0 

K^ 

m 

r— 1 

i> 

o 

in 

t- 

P* 

mo 

m 

CO 

o 

co 

o 

CM 

o 

^j 

r— 1 

1— ( 

O 

o 

o 

a 

o 

o 

in 

f» 

CM 

>n 

r» 

<r 

N1 

o 

<c 

CO 

in 

<f 

-t 

in 

MO 

r— 1 

m 

rv^ 

o 

o 

r— 1 

CM 

— i 

o 

a 

o 

c 

o 

o 

o 

o 

o  o 

MO    MO 


CO 

c 

0> 

o> 

r> 

, — i 

in 

<r 

m 

<t 

<3^ 

m 

CO 

in 

o 

o 

o 

r^ 

o 

o 

CN 

c 

St 

3 

pH 

C, 

r> 

C 

o 

C 

CM 

o 

•1 

c 

r— 1 

o 

O 

o 

a 

o 

3 

CM 

O 

<r 

o 

<—< 

o 

r^ 

o 

O 

c 

CM 

3 

<r 

o 

r— 1 

o 

r^ 

o 

a 

r» 

in 

in 

CO 

►n 

r~ 

m 

r— 1 

o 

o 

tf\ 

0"! 

in 

CO 

O 

o 

> 

o 

O 

o 

i> 

in 

r— 1 

CN 

m 

10 

*0 

c 

o  o 

MO     r-l 

O    3 


o 

CM 

o 

-Ct 

o 

r-l 

o 

r- 

o 

c 

-* 

CO 

H 

CM 

CM 

CT> 

r^ 

N"> 

O 

o 

O 

CM 

o 

<f 

o 

r- 1 

o 

[»• 

c 

o 

H 
H 

X 

-a 

a 
■j 
c 
a 
a! 


HNlO4lf\\Or>00 


Date    Due 

COLLEGE  LIBRARY 
Due  Returned  Due  Returned 


n 


/    (oO 

n^77 1 


Training  in  problem  solving,   main 
160R577tC2 


3  12b2  033E3  TbbT 


